← 返回 Skills 市场
larriewong27

zt-web-fetcher

作者 larriewong27 · GitHub ↗ · v1.0.0 · MIT-0
cross-platform ✓ 安全检测通过
256
总下载
0
收藏
0
当前安装
1
版本数
在 OpenClaw 中安装
/install zt-web-fetcher
功能描述
当需要获取网页内容时使用(搜索结果页面、博客文章、文档等)。使用 URL 转 Markdown 服务将网页转换为可读文本。 触发场景:用户说"帮我查一下"、"看看这个链接"、"获取 xx 的信息"等需要上网抓信息的情况。
使用说明 (SKILL.md)

网页抓取

当需要获取网页内容时,按以下顺序尝试:

首选方案:URL 转 Markdown 服务

  1. markdown.new/ (推荐)

    • 用法:在网址前加 https://markdown.new/
    • 例如:https://markdown.new/https://example.com
    • 适合 Cloudflare 支持的网站
  2. r.jina.ai/ (备用)

    • 用法:在网址前加 https://r.jina.ai/
    • 例如:https://r.jina.ai/https://example.com
    • 兼容性好
  3. defuddle.md/ (备用)

    • 用法:在网址前加 https://defuddle.md/
    • 例如:https://defuddle.md/https://example.com

备选方案:爬虫工具

如果以上服务都无法获取,尝试 Scrapling:

  • 地址:https://github.com/D4Vinci/Scrapling
  • 用法:pip install scrapling 后使用

使用流程

  1. 先尝试 r.jina.ai/{url} (最稳定)
  2. 如果失败,尝试 markdown.new/{url}
  3. 再失败,尝试 defuddle.md/{url}
  4. 都失败再考虑 Scrapling

注意事项

  • 不需要配置任何搜索 API
  • 这些服务会将网页转换为纯文本/ Markdown 格式
  • 适合大多数静态网页
  • 对于需要登录的页面可能无效
安全使用建议
This skill is coherent for fetching and converting webpages, but be aware of two practical risks before using it: (1) The URL-to-Markdown services (r.jina.ai, markdown.new, defuddle.md) will fetch the given URL themselves, so do not send private, authenticated, or sensitive URLs you don't want a third party to see. (2) The suggested fallback ('pip install scrapling' from GitHub) would run third-party code in your environment—review that repository and prefer installing only vetted packages. If you need to fetch pages behind login or that contain sensitive data, do not rely on these public converters; instead use a controlled, audited crawler or provide the content directly.
功能分析
Type: OpenClaw Skill Name: zt-web-fetcher Version: 1.0.0 The skill bundle provides instructions for an AI agent to fetch web content by utilizing legitimate third-party URL-to-Markdown conversion services such as r.jina.ai, markdown.new, and defuddle.md. It also suggests the use of a well-known open-source Python library (Scrapling) as a fallback. The instructions in SKILL.md are clearly aligned with the stated purpose of web fetching and do not contain any indicators of malicious intent, data exfiltration, or unauthorized execution.
能力评估
Purpose & Capability
Name/description match the SKILL.md: the skill converts webpages to Markdown using r.jina.ai, markdown.new, defuddle.md and—if those fail—suggests a Scraping fallback. It requests no credentials, binaries, or config paths, which is consistent with its stated purpose.
Instruction Scope
Instructions stay within the scraping/formatting scope, but they direct the agent to fetch webpages via third-party URL-to-Markdown services (r.jina.ai, markdown.new, defuddle.md). Those services will receive the target URL (and will fetch page content), so private pages or sensitive URLs would be exposed to third parties. The SKILL.md also suggests 'pip install scrapling' as a fallback—this would cause code to be installed/executed in the runtime environment and should be vetted before use. There is a minor internal inconsistency in which service is 'preferred' vs the ordered try sequence.
Install Mechanism
There is no formal install spec (instruction-only), which is low risk. The fallback recommendation to 'pip install scrapling' points to a GitHub project; installing that package would execute third-party code from a repo (moderate risk) and should be reviewed before installation. The primary flows (using URL-to-Markdown endpoints) do not require installing code.
Credentials
No environment variables, credentials, or config paths are requested. The skill does not ask for unrelated secrets or high-privilege access.
Persistence & Privilege
always is false and there is no install-time modification or persistent configuration. The skill does not request elevated or permanent presence beyond normal invocation.
如何使用
  1. 确保已安装 OpenClaw(本地或 Docker 部署)
  2. 在对话框中输入安装命令:/install zt-web-fetcher
  3. 安装完成后,直接呼叫该 Skill 的名称或使用 /zt-web-fetcher 触发
  4. 根据 Skill 的参数说明提供必要输入,即可获得结构化输出
版本历史
v1.0.0
Version 1.0.0 of zt-web-fetcher - Initial release with detailed instructions for fetching web content using URL-to-Markdown services. - Describes preferred services (markdown.new, r.jina.ai, defuddle.md) and fallback options. - Outlines step-by-step usage process and fallback to Scrapling tool if needed. - Includes usage scenarios and important notes for compatibility and limitations. - No requirement for search API configuration.
元数据
Slug zt-web-fetcher
版本 1.0.0
许可证 MIT-0
累计安装 0
当前安装数 0
历史版本数 1
常见问题

zt-web-fetcher 是什么?

当需要获取网页内容时使用(搜索结果页面、博客文章、文档等)。使用 URL 转 Markdown 服务将网页转换为可读文本。 触发场景:用户说"帮我查一下"、"看看这个链接"、"获取 xx 的信息"等需要上网抓信息的情况。 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件,目前累计下载 256 次。

如何安装 zt-web-fetcher?

在 OpenClaw 或 Claude Code 对话框中运行命令「/install zt-web-fetcher」即可一键安装,无需额外配置。

zt-web-fetcher 是免费的吗?

是的,zt-web-fetcher 完全免费,采用 MIT-0 许可证,可自由下载、安装和使用。

zt-web-fetcher 支持哪些平台?

zt-web-fetcher 跨平台运行,可在任意部署了 OpenClaw / Claude Code 的环境中使用(cross-platform)。

谁开发了 zt-web-fetcher?

由 larriewong27(@larriewong27)开发并维护,当前版本 v1.0.0。

💬 留言讨论