← 返回 Skills 市场
48
总下载
0
收藏
0
当前安装
1
版本数
在 OpenClaw 中安装
/install scraper-pro
功能描述
Extract data from websites and APIs for analysis. Use when user needs to collect product prices from e-commerce sites, gather news articles, extract structur...
安全使用建议
This skill contains an executable Python scraper but the documentation overstates its capabilities (login, click-style pagination, XPath) which the script does not implement — treat those docs as inaccurate. Before using: (1) inspect or run the script in a safe sandbox; (2) do not pass credentials or sensitive file paths to the tool (it will write files to paths you specify); (3) fix or remove the TLS verification bypass in fetch_page (re-enable certificate checks) unless you understand and accept the risk; (4) test scraping on non-sensitive, permitted sites and confirm legal/robots.txt compliance; (5) if you need authentication/pagination/XPath support, either extend the script yourself or obtain a tool that explicitly implements and documents those features.
功能分析
Type: OpenClaw Skill
Name: scraper-pro
Version: 1.0.0
The skill bundle contains a web scraping script (scripts/scrape.py) that explicitly disables SSL certificate verification (ssl.CERT_NONE), which is a high-risk security vulnerability allowing for Man-in-the-Middle (MITM) attacks. Additionally, there is a discrepancy between the documentation (SKILL.md), which claims to support authentication and a '--login' flag, and the actual Python implementation which lacks these features. While these are significant flaws, they appear to be unintentional vulnerabilities rather than active malware.
能力评估
Purpose & Capability
The name/description promise features (CSS/XPath selectors, pagination types including click, authentication/login support) that are not implemented in the included script. The SKILL.md shows a --login option and complex YAML pagination examples, but scripts/scrape.py does not accept a --login argument, does not implement click-based pagination, and does not implement XPath or robust selector parsing. This mismatch is incoherent and may mislead users about capabilities.
Instruction Scope
Runtime instructions tell the agent to run the bundled Python script with user-supplied URLs and output paths. The script performs network fetches and writes files but does not read other system files or environment variables. However, the code disables TLS certificate validation (ssl.CERT_NONE and check_hostname=False) when fetching pages, which weakens transport security and can enable MITM attacks; the SKILL.md and 'Best Practices' recommend checking robots.txt and respecting rate limits but do not disclose the TLS bypass. The documentation also references command-line options (--login) that are absent from the code.
Install Mechanism
No install spec; instruction-only with a small included Python script. Nothing is downloaded or written by an installer, which limits the installation attack surface.
Credentials
The skill requests no environment variables, credentials, or config paths. That is proportionate for a generic scraper. There is no evidence the code attempts to access other secrets or unrelated system configuration.
Persistence & Privilege
The skill is not always-enabled and does not request persistent system-wide privileges or modify other skills. It only runs when invoked and writes output files specified by the user.
如何使用
- 确保已安装 OpenClaw(本地或 Docker 部署)
- 在对话框中输入安装命令:
/install scraper-pro - 安装完成后,直接呼叫该 Skill 的名称或使用
/scraper-pro触发 - 根据 Skill 的参数说明提供必要输入,即可获得结构化输出
版本历史
v1.0.0
Initial release
元数据
常见问题
Data Scraper 是什么?
Extract data from websites and APIs for analysis. Use when user needs to collect product prices from e-commerce sites, gather news articles, extract structur... 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件,目前累计下载 48 次。
如何安装 Data Scraper?
在 OpenClaw 或 Claude Code 对话框中运行命令「/install scraper-pro」即可一键安装,无需额外配置。
Data Scraper 是免费的吗?
是的,Data Scraper 完全免费,采用 MIT-0 许可证,可自由下载、安装和使用。
Data Scraper 支持哪些平台?
Data Scraper 跨平台运行,可在任意部署了 OpenClaw / Claude Code 的环境中使用(cross-platform)。
谁开发了 Data Scraper?
由 BIN(@dinghaibin)开发并维护,当前版本 v1.0.0。
推荐 Skills