← 返回 Skills 市场
242
总下载
0
收藏
0
当前安装
1
版本数
在 OpenClaw 中安装
/install webscraper
功能描述
Extract readable content from web pages. Use when: user wants to read article content, fetch documentation, grab product info, or get text from URLs. NOT for...
安全使用建议
This skill appears to do what it says (fetch and extract page content), but the runtime instructions include unsafe command patterns and operational advice you should not run verbatim. Before installing or using: (1) avoid the node -e $(curl ...) pattern — instead download HTML to a file (curl -s URL > page.html) and run a safe parser that reads the file, or fetch directly from Node using libraries (axios/fetch) to avoid shell injection; (2) prefer installing libraries per-project rather than npm -g to reduce global risk; (3) do not use proxies or UA tricks to bypass site protections unless you have explicit permission — this may violate terms of service and law; (4) be cautious piping remote content into executables (curl | program) because that can execute untrusted data. If the maintainer can sanitize the examples (safe Node fetch, avoid shell interpolation of remote data, clarify proxy guidance), the skill would be coherent and much safer.
功能分析
Type: OpenClaw Skill
Name: webscraper
Version: 1.0.0
The webscraper skill bundle provides standard instructions and command-line examples (using curl and Node.js) for an AI agent to extract content from web pages. The code and markdown files (SKILL.md, package.json) align strictly with the stated purpose of web scraping and include best practices such as rate limiting and error handling without any signs of malicious intent or data exfiltration.
能力评估
Purpose & Capability
Name, description, and declared binaries (curl, node) are appropriate for a web content extraction skill. No unrelated credentials, config paths, or unexpected system access are requested.
Instruction Scope
Most instructions stay within scraping/extraction scope, but several recommendations are risky or inconsistent: (1) the provided Node one-liner embeds $(curl ...) into a node -e string, which causes shell substitution of untrusted HTML into executable JS and can enable command injection or execution if the fetched content contains quotes/backticks; (2) suggestions to 'use proxy' and to set UA to avoid bot detection encourage evasion of anti-bot measures (conflicts with the 'Respect robots.txt' admonition); (3) use of curl | readability and piping remote content into local commands is suggested without caution about executing untrusted data. These are sloppy/insecure operational patterns that could lead to accidental code execution or misuse.
Install Mechanism
The skill is instruction-only (no install spec) which is low-risk, but the doc recommends installing global tools (npm -g cheerio, readability-cli, html2text). Global npm installs and suggested third-party CLIs are normal for this task but increase attack surface and require user discretion; no install URLs or obscure downloads are present in the package metadata.
Credentials
The skill does not request environment variables, credentials, or config paths. Recommendations (e.g., using proxies) might imply credential usage in practice, but nothing is declared or required by the skill itself.
Persistence & Privilege
Flags are default (always:false, user-invocable:true, autonomous invocation allowed). The skill does not request permanent system presence nor modify other skills or system configs.
如何使用
- 确保已安装 OpenClaw(本地或 Docker 部署)
- 在对话框中输入安装命令:
/install webscraper - 安装完成后,直接呼叫该 Skill 的名称或使用
/webscraper触发 - 根据 Skill 的参数说明提供必要输入,即可获得结构化输出
版本历史
v1.0.0
Initial release: web content extraction
元数据
常见问题
WebScraper 是什么?
Extract readable content from web pages. Use when: user wants to read article content, fetch documentation, grab product info, or get text from URLs. NOT for... 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件,目前累计下载 242 次。
如何安装 WebScraper?
在 OpenClaw 或 Claude Code 对话框中运行命令「/install webscraper」即可一键安装,无需额外配置。
WebScraper 是免费的吗?
是的,WebScraper 完全免费,采用 MIT-0 许可证,可自由下载、安装和使用。
WebScraper 支持哪些平台?
WebScraper 跨平台运行,可在任意部署了 OpenClaw / Claude Code 的环境中使用(cross-platform)。
谁开发了 WebScraper?
由 LesliePie(@lesliepie)开发并维护,当前版本 v1.0.0。
推荐 Skills