← 返回 Skills 市场
jnmhub

Scrape Web

作者 李金木 · GitHub ↗ · v1.0.0 · MIT-0
cross-platform ✓ 安全检测通过
2537
总下载
1
收藏
9
当前安装
1
版本数
在 OpenClaw 中安装
/install scrape-web
功能描述
使用 Python + Scrapling 获取网页内容,支持简单选择器
使用说明 (SKILL.md)

Scrape Web Skill

使用 Scrapling 获取网页内容,返回纯文本或选择器结果。

安装依赖

pip install "scrapling[all]"
scrapling install
pip install httpx

用法

1) 直接抓取纯文本

python scripts/scrape_web.py --url "https://example.com"

2) 使用 CSS 选择器

python scripts/scrape_web.py --url "https://example.com" --selector "title::text"

3) 保存到文件

python scripts/scrape_web.py --url "https://example.com" --out "output.txt"
安全使用建议
This skill is internally consistent with a web-scraping utility. Before installing, be aware that: (1) you will need a Python environment and will run pip install commands that pull third-party packages (inspect those packages if you need to vet supply-chain risk); (2) 'scrapling install' typically downloads browser binaries (Chromium), which increases disk/network activity; (3) the script will fetch any URL you give it — avoid scraping private/internal resources or sites you don't have permission to access; and (4) no secrets are requested by the skill itself, but be careful not to pass sensitive URLs or credentials to the tool. If you want higher assurance, review the scrapling package's install steps and source before running the install commands.
功能分析
Type: OpenClaw Skill Name: scrape-web Version: 1.0.0 The skill is a standard web scraping utility that uses the legitimate 'scrapling' and 'httpx' libraries to fetch and parse web content. The Python script (scripts/scrape_web.py) implements expected functionality such as CSS selector support and optional file output, with no evidence of malicious intent, data exfiltration, or obfuscation.
能力评估
Purpose & Capability
Name/description, SKILL.md, and the included Python script all align: the skill fetches pages (httpx or Scrapling) and supports CSS-like selectors. No unrelated credentials, binaries, or capabilities are requested.
Instruction Scope
Runtime instructions stay within scraping: pip install scrapling[all], scrapling install, pip install httpx, then run the script with --url/--selector/--out. Note: 'scrapling install' may download browser components (Chromium) and the StealthyFetcher will execute headless browser fetches, which is expected for this functionality but increases runtime side effects.
Install Mechanism
There is no formal install spec in the registry; the SKILL.md instructs the operator to pip-install dependencies and run 'scrapling install'. This uses PyPI (normal) and likely downloads browser binaries via scrapling, which is expected but more heavyweight than a pure-HTTP library.
Credentials
The skill declares 'python' in requires.env which is unusual (the code does not read a 'python' env var). This appears to be a check that Python is available rather than a secret. No sensitive credentials or unrelated env vars are requested.
Persistence & Privilege
The skill is not always-enabled and does not request elevated platform privileges. It does not modify other skills or system config. Autonomous invocation is allowed (platform default) but not combined with other concerning flags.
如何使用
  1. 确保已安装 OpenClaw(本地或 Docker 部署)
  2. 在对话框中输入安装命令:/install scrape-web
  3. 安装完成后,直接呼叫该 Skill 的名称或使用 /scrape-web 触发
  4. 根据 Skill 的参数说明提供必要输入,即可获得结构化输出
版本历史
v1.0.0
Version 1.1.0 introduces documentation updates for improved usage and installation guidance. - Added SKILL.md detailing installation steps and command examples. - Clarified how to scrape web content, use CSS selectors, and save results to files. - Provided specific dependency installation commands.
元数据
Slug scrape-web
版本 1.0.0
许可证 MIT-0
累计安装 10
当前安装数 9
历史版本数 1
常见问题

Scrape Web 是什么?

使用 Python + Scrapling 获取网页内容,支持简单选择器. 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件,目前累计下载 2537 次。

如何安装 Scrape Web?

在 OpenClaw 或 Claude Code 对话框中运行命令「/install scrape-web」即可一键安装,无需额外配置。

Scrape Web 是免费的吗?

是的,Scrape Web 完全免费,采用 MIT-0 许可证,可自由下载、安装和使用。

Scrape Web 支持哪些平台?

Scrape Web 跨平台运行,可在任意部署了 OpenClaw / Claude Code 的环境中使用(cross-platform)。

谁开发了 Scrape Web?

由 李金木(@jnmhub)开发并维护,当前版本 v1.0.0。

💬 留言讨论