Add FetchRelay web extraction and bounded crawl tools 0.0.1 - #3029
Closed
skrcode wants to merge 1 commit into
Closed
Add FetchRelay web extraction and bounded crawl tools 0.0.1#3029skrcode wants to merge 1 commit into
skrcode wants to merge 1 commit into
Conversation
skrcode
marked this pull request as ready for review
September 7, 2026 06:17
Member
|
Closing this PR because the current Pre Check Plugin / pre-check-plugin CI run failed. CI summary:
Please address the reported failures (or rerun CI if the failure was transient) before requesting reopening or resubmitting. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Plugin Submission
Plugin information
Submission type
What changed
Adds public webpage extraction to Markdown, bounded asynchronous crawling (maximum 10 pages and depth 2), and crawl status retrieval through the hosted FetchRelay API. Users supply their own API key. Credential validation checks the account without consuming extraction credits.
Risk level
Required checks
.envfiles,.gitdirectories, virtual environments, caches, logs, or IDE files.PRIVACY.md, andmanifest.yamlreferences it.Security and privacy notes
The service extracts and crawls user-supplied public URLs, including browser rendering on the backend. The plugin calls only the fixed HTTPS FetchRelay API with redirects disabled and a 40-second client timeout. It does not execute local commands, accept alternate API hosts, or expose API credentials in errors. Status requests validate job IDs. URLs and content pass through FetchRelay and Dify. Website content remains untrusted; JSON outputs retain diagnostics. Successful extraction consumes the user's FetchRelay credits.
Local validation
Reviewer notes
The owner has acknowledged the Plugin Developer Agreement. Dify Cloud and Community Edition installation and workflow execution have not been verified; this limitation is also documented in the package README. Do not treat the SDK and API smoke tests as full workspace verification.