← 返回 Skills 市场
12627
总下载
10
收藏
0
当前安装
2
版本数
在 OpenClaw 中安装
/install deep-scraper
功能描述
Performs deep scraping of complex sites like YouTube using containerized Crawlee, extracting validated, ad-free transcripts and content as JSON output.
安全使用建议
Review before installing. Only run this skill against URLs you are authorized to scrape, and avoid using it in environments where the container can reach private services, cloud metadata endpoints, intranet sites, or sensitive local web apps. Prefer adding strict URL allowlists, private-network blocking, redirect validation, pinned dependencies, and a complete pinned Docker build before use.
功能分析
Type: OpenClaw Skill
Name: deep-scraper
Version: 1.0.1
The skill bundle is classified as benign. It implements a web scraper using Docker, Crawlee, and Playwright, which aligns with its stated purpose of 'deep web scraping' and 'penetrating protections' on complex websites. While it utilizes Docker and runs Playwright with `--no-sandbox` (a common requirement for Playwright in Docker that reduces in-container security), these capabilities are plausibly needed for its function. The code in `assets/main_handler.js` and `assets/youtube_handler.js` focuses on scraping public web content, outputs results to stdout, clears cookies to prevent session leakage, and does not exhibit any signs of data exfiltration, malicious execution, persistence, prompt injection against the agent, or obfuscation. The `SKILL.md` explicitly forbids scraping password-protected or non-public personal information, indicating a consideration for privacy.
能力评估
Credentials
A containerized browser is proportionate for dynamic-page scraping, but unrestricted browser navigation from the container is broader than needed and can turn the container's network position into an unintended data source.
Install Mechanism
Installation is manual and Docker-based, with a local assets volume and --rm container cleanup. The documented image tag is local but unpinned, and the artifact references a Dockerfile that is not present in the inspected package.
Instruction Scope
The instructions disclose Docker, browser automation, scraping, and raw interception, but they do not scope scraping to authorized public targets beyond a general privacy rule, and the implementation can navigate to non-YouTube generic URLs and print page text.
Persistence & Privilege
No durable service, scheduler, backdoor, or host persistence was found. The scripts clear browser cookies inside the Playwright context and run with Chromium sandbox-disabling flags for Docker, which increases runtime exposure but is not persistence.
Purpose & Capability
The stated purpose is deep scraping with Playwright/Crawlee, and the code does scrape YouTube transcripts/descriptions and generic page text; however, the same capability is exposed for arbitrary TARGET_URL values with no scheme, host, private-IP, redirect, or destination validation.
如何使用
- 确保已安装 OpenClaw(本地或 Docker 部署)
- 在对话框中输入安装命令:
/install deep-scraper - 安装完成后,直接呼叫该 Skill 的名称或使用
/deep-scraper触发 - 根据 Skill 的参数说明提供必要输入,即可获得结构化输出
版本历史
v1.0.1
Included Dockerfile in the package
v1.0.0
Initial release
元数据
常见问题
Deep Scraper 是什么?
Performs deep scraping of complex sites like YouTube using containerized Crawlee, extracting validated, ad-free transcripts and content as JSON output. 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件,目前累计下载 12627 次。
如何安装 Deep Scraper?
在 OpenClaw 或 Claude Code 对话框中运行命令「/install deep-scraper」即可一键安装,无需额外配置。
Deep Scraper 是免费的吗?
是的,Deep Scraper 完全免费(开源免费),可自由下载、安装和使用。
Deep Scraper 支持哪些平台?
Deep Scraper 跨平台运行,可在任意部署了 OpenClaw / Claude Code 的环境中使用(cross-platform)。
谁开发了 Deep Scraper?
由 opsun(@opsun)开发并维护,当前版本 v1.0.1。
推荐 Skills