Skip to content

Add FetchRelay web extraction and bounded crawl tools 0.0.1 - #3029

Closed
skrcode wants to merge 1 commit into
langgenius:mainfrom
skrcode:add-fetchrelay-0.0.1
Closed

Add FetchRelay web extraction and bounded crawl tools 0.0.1#3029
skrcode wants to merge 1 commit into
langgenius:mainfrom
skrcode:add-fetchrelay-0.0.1

Conversation

@skrcode

@skrcode skrcode commented Sep 7, 2026

Copy link
Copy Markdown

Plugin Submission

Plugin information

Submission type

  • New plugin
  • Version update

What changed

Adds public webpage extraction to Markdown, bounded asynchronous crawling (maximum 10 pages and depth 2), and crawl status retrieval through the hosted FetchRelay API. Users supply their own API key. Credential validation checks the account without consuming extraction credits.

Risk level

  • Low risk
  • Medium risk
  • High risk

Required checks

  • I have read and followed the Marketplace submission requirements.
  • I have read and comply with the Plugin Developer Agreement.
  • I tested this plugin on Dify Community Edition and Dify Cloud, or documented any limitation below.
  • The package contains only files needed at runtime.
  • The package does not contain secrets, local credentials, .env files, .git directories, virtual environments, caches, logs, or IDE files.
  • The package does not contain executables or bundled binaries.
  • The plugin README includes setup steps, usage instructions, required APIs or credentials, connection requirements, and the source repository link.
  • The plugin includes PRIVACY.md, and manifest.yaml references it.
  • All user-facing text is primarily in English.

Security and privacy notes

The service extracts and crawls user-supplied public URLs, including browser rendering on the backend. The plugin calls only the fixed HTTPS FetchRelay API with redirects disabled and a 40-second client timeout. It does not execute local commands, accept alternate API hosts, or expose API credentials in errors. Status requests validate job IDs. URLs and content pass through FetchRelay and Dify. Website content remains untrusted; JSON outputs retain diagnostics. Successful extraction consumes the user's FetchRelay credits.

Local validation

  • Python 3.12, dify_plugin 0.10.2: five unit tests passed.
  • SDK manifest/provider/tool loading passed.
  • Live credential validation and Example Domain extraction passed with a disposable account.
  • Official Dify CLI 0.6.10 packaged successfully; archive checked for runtime-only files and no secrets.

Reviewer notes

The owner has acknowledged the Plugin Developer Agreement. Dify Cloud and Community Edition installation and workflow execution have not been verified; this limitation is also documented in the package README. Do not treat the SDK and API smoke tests as full workspace verification.

@github-actions github-actions Bot added the risk: high High-risk Marketplace submission label Sep 7, 2026
@skrcode
skrcode marked this pull request as ready for review September 7, 2026 06:17
@crazywoola

Copy link
Copy Markdown
Member

Closing this PR because the current Pre Check Plugin / pre-check-plugin CI run failed.

CI summary:

  • Manifest is missing the required contact field.

Failed CI job

Please address the reported failures (or rerun CI if the failure was transient) before requesting reopening or resubmitting.

@crazywoola crazywoola closed this Sep 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

risk: high High-risk Marketplace submission

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants