← 返回 Skills 市场
Web Scraping
作者
zhangqixin9527
· GitHub ↗
· v1.0.0
· MIT-0
13868
总下载
6
收藏
0
当前安装
1
版本数
在 OpenClaw 中安装
/install web-scraping
功能描述
Extract structured information from websites using web_fetch for simple pages and browser automation for dynamic sites, login-gated flows, pagination, infini...
安全使用建议
Before installing, understand that this skill can guide an agent to scrape dynamic or login-gated pages and save larger results in the workspace. Use it only for sites and fields you intentionally specify, avoid scraping secrets or unnecessary personal data, and review saved files when working with authenticated content.
能力评估
Credentials
Browser/session use and saving scraped results to workspace files can involve sensitive website content, but those behaviors are disclosed and proportionate for a scraping skill.
Install Mechanism
The inspected artifact is a single Markdown skill file with no executable scripts, dependencies, install hooks, or remote payload retrieval.
Instruction Scope
The trigger text is somewhat broad and includes monitoring, summaries, pagination, infinite scroll, and login-gated flows, but the runtime workflow directs the agent to identify target sites and exact fields, test one page first, and extract only requested fields.
Persistence & Privilege
The only persistence described is task output or checkpoints saved under the workspace with clear names; there is no system persistence, privilege escalation, memory poisoning, or tool hijacking.
Purpose & Capability
The skill is narrowly about extracting structured information from websites using web_fetch, browser automation, or web_search discovery, and its capabilities fit that purpose.
如何使用
- 确保已安装 OpenClaw（本地或 Docker 部署）
- 在对话框中输入安装命令：
/install web-scraping - 安装完成后，直接呼叫该 Skill 的名称或使用
/web-scraping触发 - 根据 Skill 的参数说明提供必要输入，即可获得结构化输出
版本历史
v1.0.0
- Initial release of the web-scraping skill.
- Supports data extraction from both static and dynamic websites.
- Automatically chooses between direct HTML fetching and browser automation based on site complexity and interaction needs.
- Handles dynamic content, authentication, infinite scroll, pagination, and search/filter flows.
- Outputs structured data in concise bullet lists, JSON, or CSV formats.
- Includes reliability rules for deduplication, error handling, and workspace file management.
元数据
常见问题
Web Scraping 是什么？
Extract structured information from websites using web_fetch for simple pages and browser automation for dynamic sites, login-gated flows, pagination, infini... 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件，目前累计下载 13868 次。
如何安装 Web Scraping？
在 OpenClaw 或 Claude Code 对话框中运行命令「/install web-scraping」即可一键安装，无需额外配置。
Web Scraping 是免费的吗？
是的，Web Scraping 完全免费，采用 MIT-0 许可证，可自由下载、安装和使用。
Web Scraping 支持哪些平台？
Web Scraping 跨平台运行，可在任意部署了 OpenClaw / Claude Code 的环境中使用（cross-platform）。
谁开发了 Web Scraping？
由 zhangqixin9527（@zhangqixin9527）开发并维护，当前版本 v1.0.0。
推荐 Skills