← 返回 Skills 市场
scrape
作者
TobeyRebecca
· GitHub ↗
· v1.0.0
· MIT-0
65
总下载
0
收藏
0
当前安装
1
版本数
在 OpenClaw 中安装
/install toby-scrape
功能描述
Legal web scraping with robots.txt compliance, rate limiting, and GDPR/CCPA-aware data handling. Supports both direct HTTP scraping and managed scraping via...
安全使用建议
This skill appears to implement a legitimate scraper and a managed scraping option via api.skillbossai.com, but there are a few things to check before installing:
- Metadata mismatch: the registry says no env vars are required but SKILL.md and code read SKILLBOSS_API_KEY. Do not provide any API key until the publisher corrects the metadata or you verify the key's intended use.
- Third-party endpoint: the skill will send requests and scraped content to https://api.skillbossai.com when you use the managed path. Verify who operates SkillBoss, what data they retain, and the key's scope and revocation process.
- Data exposure: if you use the SkillBoss path, scraped page content (including any inadvertently collected PII) will be transmitted to that external service. Only run against data you are authorized to process, and test with non-sensitive pages first.
- Least privilege: if you must provide SKILLBOSS_API_KEY, create a key with minimal privileges and the ability to revoke it quickly.
- Source provenance: the skill's homepage and source are unknown. Prefer skills with verifiable source repositories or vendor pages. Ask the publisher for a homepage/source and an explanation for the metadata mismatch.
If you cannot verify the publisher or the SkillBoss service, run the direct-http code locally in an isolated environment (no real credentials) and avoid using the managed SkillBoss path until you've confirmed safety.
功能分析
Type: OpenClaw Skill
Name: toby-scrape
Version: 1.0.0
The 'toby-scrape' skill provides a well-documented framework for ethical web scraping, emphasizing compliance with robots.txt, rate limiting, and data privacy (GDPR/CCPA). The code in code.md implements standard best practices for polite fetching and integrates with a managed scraping service (api.skillbossai.com) using an API key. No malicious behaviors, obfuscation, or data exfiltration attempts were identified.
能力标签
能力评估
Purpose & Capability
The SKILL.md and code clearly implement a scraper and an optional integration with a 'SkillBoss API Hub' (api.skillbossai.com) which requires SKILLBOSS_API_KEY — that fits the described purpose. However the registry metadata says 'Required env vars: none' while SKILL.md and code require SKILLBOSS_API_KEY, an inconsistency that should be resolved before trusting the skill.
Instruction Scope
The runtime instructions focus on robots.txt, ToS checks, rate limiting, PII handling, and using either direct HTTP or the SkillBoss API Hub. The code examples only reference scraping-related files, HTTP requests, and the declared SKILLBOSS_API_KEY; there is no unrelated file/system access or vague 'gather context' language.
Install Mechanism
This is an instruction-only skill with no install spec and no code files to be executed by the platform. That minimizes install-time risk.
Credentials
Functionality legitimately needs a single API credential (SKILLBOSS_API_KEY) for the managed scraping path — that's proportionate. The concern is the metadata mismatch: the registry lists no required env vars while the SKILL.md and code access SKILLBOSS_API_KEY. Also the SkillBoss API is a third-party endpoint; users should confirm the trust model and key scope before providing credentials.
Persistence & Privilege
The skill is not marked always:true and does not request persistent system-wide privileges. It is user-invocable and allows autonomous invocation (platform default), which is expected for skills.
如何使用
- 确保已安装 OpenClaw（本地或 Docker 部署）
- 在对话框中输入安装命令：
/install toby-scrape - 安装完成后，直接呼叫该 Skill 的名称或使用
/toby-scrape触发 - 根据 Skill 的参数说明提供必要输入，即可获得结构化输出
版本历史
v1.0.0
Scrape skill v1.0.0 — initial release with robust legal compliance and managed scraping features:
- Enforces robots.txt compliance, terms of service checks, and rate limiting for ethical web scraping.
- Includes guidelines for GDPR/CCPA-aware data handling and strict personal data protection.
- Supports both direct HTTP-based scraping and managed scraping via SkillBoss API Hub.
- Provides a comprehensive pre-scrape checklist and legal boundaries for safe operation.
- Requires SKILLBOSS_API_KEY for SkillBoss-managed scraping with automatic anti-bot protection.
元数据
常见问题
scrape 是什么？
Legal web scraping with robots.txt compliance, rate limiting, and GDPR/CCPA-aware data handling. Supports both direct HTTP scraping and managed scraping via... 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件，目前累计下载 65 次。
如何安装 scrape？
在 OpenClaw 或 Claude Code 对话框中运行命令「/install toby-scrape」即可一键安装，无需额外配置。
scrape 是免费的吗？
是的，scrape 完全免费，采用 MIT-0 许可证，可自由下载、安装和使用。
scrape 支持哪些平台？
scrape 跨平台运行，可在任意部署了 OpenClaw / Claude Code 的环境中使用（cross-platform）。
谁开发了 scrape？
由 TobeyRebecca（@tobeyrebecca）开发并维护，当前版本 v1.0.0。
推荐 Skills