Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix/url parse error #644

Merged
merged 5 commits into from
Mar 24, 2025
Merged

Fix/url parse error #644

merged 5 commits into from
Mar 24, 2025

Conversation

pftom
Copy link
Contributor

@pftom pftom commented Mar 24, 2025

Summary

Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.

Tip

Close issue syntax: Fixes #<issue number> or Resolves #<issue number>, see documentation for more details.

Impact Areas

Please check the areas this PR affects:

  • Multi-threaded Dialogues
  • AI-Powered Capabilities (Web Search, Knowledge Base Search, Question Recommendations)
  • Context Memory & References
  • Knowledge Base Integration & RAG
  • Quotes & Citations
  • AI Document Editing & WYSIWYG
  • Free-form Canvas Interface
  • Other

Screenshots/Videos

Before After
... ...

Checklist

Important

Please review the checklist below before submitting your pull request.

  • This change requires a documentation update, included: Refly Documentation
  • I understand that this PR may be closed in case there was no previous discussion or issues. (This doesn't apply to typos!)
  • I've added a test for each change that was introduced, and I tried as much as possible to make a single atomic change.
  • I've updated the documentation accordingly.
  • I ran dev/reformat(backend) and cd web && npx lint-staged(frontend) to appease the lint gods

pftom added 5 commits March 24, 2025 18:03
…nalysis

- Introduced a new module for filtering static resources and CDN links from URLs, including functions for analyzing URLs with LLM and programmatic checks.
- Implemented a schema for batch analysis of URLs using Zod for validation.
- Updated the `crawlExtractedUrls` function to optionally skip CDN filtering, enhancing flexibility in URL processing.
- Ensured compliance with code style rules, including the use of single quotes for string literals.
…oken limit

- Introduced MAX_URL_SOURCES_TOKENS constant to define the maximum token limit for URL sources, calculated as double the MAX_OUTPUT_TOKENS_LEVEL3.
- Updated semanticSearch utility functions to utilize MAX_URL_SOURCES_TOKENS when processing page content from URL sources, ensuring efficient token management.
- Ensured compliance with code style rules, including the use of single quotes for string literals.
- Wrapped context preparation logic in try-catch blocks to handle unexpected errors gracefully, logging errors and returning empty results when necessary.
- Ensured proper logging of relevant context tokens and remaining tokens throughout the process for better traceability.
- Updated semantic search functions to include error handling, returning fallback values in case of failures.
- Ensured compliance with code style rules, including the use of single quotes for string literals.
- Integrated resetFailedState function to manage failed result IDs, preventing auto-restarting of polling for failed actions.
- Updated SkillResponseNode and SkillResponseNodePreviewComponent to utilize resetFailedState before retrying actions, improving error handling.
- Ensured compliance with code style rules, including the use of single quotes for string literals and proper dependency management in useEffect hooks.
…omponent

- Implemented a null check for the artifact title to prevent rendering issues when the title is undefined.
- Ensured compliance with code style rules, including the use of single quotes for string literals and proper handling of optional chaining.
@pftom pftom merged commit 7f9b551 into main Mar 24, 2025
1 check passed
@mrcfps mrcfps deleted the fix/url-parse-error branch March 24, 2025 14:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants