← 返回 Skills 市场
youpele52

Website Scraper Pro

作者 youpele52 · GitHub ↗ · v0.1.0 · MIT-0
cross-platform ✓ 安全检测通过
386
总下载
0
收藏
0
当前安装
1
版本数
在 OpenClaw 中安装
/install website-scraper-pro
功能描述
Run a local script to scrape a single web page into clean markdown or deterministic JSON with Crawl4AI. Use when: user needs direct page retrieval from a URL...
安全使用建议
This skill appears to do what it says: run a local Crawl4AI scraper for a single URL. Before installing or running it, check that the 'uv' binary on your system is the trusted tool you expect (it will execute the inline script block and install Python packages), and confirm you are comfortable having the 'crawl4ai' package and (optionally) Playwright download browser binaries (chromium) at runtime. Avoid scraping sensitive internal URLs. If you need stricter control, review the included Python files locally and run the script in an isolated environment before granting it broader agent access.
功能分析
Type: OpenClaw Skill Name: website-scraper-pro Version: 0.1.0 The skill is a legitimate tool designed to scrape single web pages into markdown or JSON using the Crawl4AI library. It includes standard configurations for handling JavaScript-heavy pages and deterministic query-based content filtering. No evidence of malicious intent, data exfiltration, or unauthorized execution was found across the codebase (e.g., src/main.py, src/service.py).
能力评估
Purpose & Capability
Name/description, CLI flags, required binary 'uv', and included Python code all align: the skill runs a local Crawl4AI-based scraper for a single URL. No unexpected credentials, system paths, or unrelated binaries are requested.
Instruction Scope
SKILL.md instructs running the bundled script via 'uv run'. The code fetches only the target URL, processes page HTML into markdown/JSON, and normalizes links. It does not read arbitrary host files or environment variables, nor does it post scraped data to external endpoints. It does suppress crawler stdout/stderr and handles browser-setup errors as expected.
Install Mechanism
Registry has no install spec, but main.py contains an inline script header that 'uv run' will use to install the 'crawl4ai' dependency into an isolated environment. This is coherent for a bundled script, but it means network package installation will occur at runtime — verify you trust the package source and the 'uv' tool that performs the install.
Credentials
No environment variables, credentials, or config paths are requested. The tool asks only for a URL and optional flags, which is proportionate to its function.
Persistence & Privilege
The skill is not always-enabled and does not request elevated or persistent system privileges or modify other skills' configurations. Autonomous invocation by the agent is allowed (default) and consistent with normal skill behavior.
如何使用
  1. 确保已安装 OpenClaw(本地或 Docker 部署)
  2. 在对话框中输入安装命令:/install website-scraper-pro
  3. 安装完成后,直接呼叫该 Skill 的名称或使用 /website-scraper-pro 触发
  4. 根据 Skill 的参数说明提供必要输入,即可获得结构化输出
版本历史
v0.1.0
Initial release of Website Scraper Pro. - Scrape a single web page into clean markdown or deterministic JSON using Crawl4AI. - Supports JS-aware scraping for client-side rendered pages. - Deterministic, query-focused narrowing of content without internal AI processing. - Outputs either markdown or structured JSON including title, links, and metadata. - Usage is limited to single-page extraction; no site-wide crawling or web search.
元数据
Slug website-scraper-pro
版本 0.1.0
许可证 MIT-0
累计安装 0
当前安装数 0
历史版本数 1
常见问题

Website Scraper Pro 是什么?

Run a local script to scrape a single web page into clean markdown or deterministic JSON with Crawl4AI. Use when: user needs direct page retrieval from a URL... 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件,目前累计下载 386 次。

如何安装 Website Scraper Pro?

在 OpenClaw 或 Claude Code 对话框中运行命令「/install website-scraper-pro」即可一键安装,无需额外配置。

Website Scraper Pro 是免费的吗?

是的,Website Scraper Pro 完全免费,采用 MIT-0 许可证,可自由下载、安装和使用。

Website Scraper Pro 支持哪些平台?

Website Scraper Pro 跨平台运行,可在任意部署了 OpenClaw / Claude Code 的环境中使用(cross-platform)。

谁开发了 Website Scraper Pro?

由 youpele52(@youpele52)开发并维护,当前版本 v0.1.0。

💬 留言讨论