← 返回 Skills 市场

Scrape

Name: Scrape
Author: ivangdavila

作者 Iván · GitHub ↗ · v1.0.0

cross-platform ⚠ suspicious

11159

总下载

当前安装

版本数

在 OpenClaw 中安装

/install scrape

功能描述

Legal web scraping with robots.txt compliance, rate limiting, and GDPR/CCPA-aware data handling.

安全使用建议

Review before installing or using the sample code. The guidance is not deceptive and does not install anything, but users should change the robots.txt check to fail closed or ask before proceeding on errors, and add URL/redirect/IP validation before using the fetcher in any shared tool, server, or workflow that accepts user-supplied URLs.

功能分析

Type: OpenClaw Skill Name: scrape Version: 1.0.0 The skill bundle is designed for ethical and legal web scraping, providing comprehensive guidelines in `SKILL.md` for compliance (robots.txt, ToS, GDPR/CCPA, rate limiting) and implementing these safeguards in `code.md`. The code uses standard Python libraries to perform web requests, handle rate limits, and log activity, all aligned with the stated purpose. There is no evidence of malicious intent, data exfiltration to unauthorized parties, persistence mechanisms, or prompt injection attempts designed to subvert the agent's purpose; instead, the instructions actively promote responsible behavior.

能力评估

⚠ Credentials

Network fetching arbitrary URLs is expected for scraping, but the sample fetcher lacks URL, redirect, hostname, IP-range, timeout, and response-size controls, making it risky if reused in a service or with untrusted targets.

✓ Install Mechanism

The artifact contains Markdown guidance and sample code only, with no executable install script, dependency installation, hooks, or package metadata requiring elevated authority.

ℹ Instruction Scope

The instructions tell users to check robots.txt, terms, authentication boundaries, and PII handling; the scanner's autonomous-decision concern is not supported by the artifact text.

✓ Persistence & Privilege

No persistence, background workers, privilege escalation, credential harvesting, memory writes, or local profile/session access were found.

⚠ Purpose & Capability

The stated purpose is legal, robots.txt-compliant scraping, but code.md returns allowed on any robots.txt retrieval or parsing exception, which undermines that purpose.

如何使用

确保已安装 OpenClaw（本地或 Docker 部署）
在对话框中输入安装命令：/install scrape
安装完成后，直接呼叫该 Skill 的名称或使用 /scrape 触发
根据 Skill 的参数说明提供必要输入，即可获得结构化输出

版本历史

v1.0.0

Initial release

元数据

Slug scrape

版本 1.0.0

许可证 —

累计安装 0

当前安装数 0

历史版本数 1

常见问题

Scrape 是什么？

Legal web scraping with robots.txt compliance, rate limiting, and GDPR/CCPA-aware data handling. 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件，目前累计下载 11159 次。

如何安装 Scrape？

在 OpenClaw 或 Claude Code 对话框中运行命令「/install scrape」即可一键安装，无需额外配置。

Scrape 是免费的吗？

是的，Scrape 完全免费（开源免费），可自由下载、安装和使用。

Scrape 支持哪些平台？

Scrape 跨平台运行，可在任意部署了 OpenClaw / Claude Code 的环境中使用（cross-platform）。

谁开发了 Scrape？

由 Iván（@ivangdavila）开发并维护，当前版本 v1.0.0。