← Back to Skills Marketplace
opsun

Deep Scraper

by opsun · GitHub ↗ · v1.0.1
cross-platform ✓ Security Clean
12384
Downloads
10
Stars
0
Active Installs
2
Versions
Install in OpenClaw
/install deep-scraper
Description
Performs deep scraping of complex sites like YouTube using containerized Crawlee, extracting validated, ad-free transcripts and content as JSON output.
Usage Guidance
Install only if you intend to run a Dockerized browser scraper. Use it only on public or explicitly authorized pages, avoid private/internal URLs and authenticated content, review or supply the missing Dockerfile, and update/pin Playwright and Crawlee before building.
Capability Analysis
Type: OpenClaw Skill Name: deep-scraper Version: 1.0.1 The skill bundle is classified as benign. It implements a web scraper using Docker, Crawlee, and Playwright, which aligns with its stated purpose of 'deep web scraping' and 'penetrating protections' on complex websites. While it utilizes Docker and runs Playwright with `--no-sandbox` (a common requirement for Playwright in Docker that reduces in-container security), these capabilities are plausibly needed for its function. The code in `assets/main_handler.js` and `assets/youtube_handler.js` focuses on scraping public web content, outputs results to stdout, clears cookies to prevent session leakage, and does not exhibit any signs of data exfiltration, malicious execution, persistence, prompt injection against the agent, or obfuscation. The `SKILL.md` explicitly forbids scraping password-protected or non-public personal information, indicating a consideration for privacy.
Capability Assessment
Purpose & Capability
The stated purpose is deep scraping of dynamic sites, and the code matches that purpose by running Crawlee/Playwright against a user-supplied URL and printing transcript, description, or page text to stdout.
Instruction Scope
The documentation forbids scraping password-protected or non-public personal information, but it uses bypass-oriented language and does not clearly require authorization, policy compliance, rate limits, or private-network target exclusions.
Install Mechanism
Installation requires Docker and a local image build, but the reviewed artifact does not include the Dockerfile referenced by the documentation and changelog; package dependencies are also not locked.
Credentials
A headless browser in Docker is proportionate for dynamic scraping, and the provided run command mounts only the skill assets, but Playwright is launched with no-sandbox flags and can browse arbitrary user-provided URLs.
Persistence & Privilege
No persistence, destructive actions, credential-store reads, broad host filesystem access, background service, or hidden outbound sink was found; the handlers clear browser cookies and output results to stdout.
How to Use
  1. Make sure OpenClaw is installed (local or Docker)
  2. Run the install command in chat: /install deep-scraper
  3. After installation, invoke the skill by name or use /deep-scraper
  4. Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.1
Included Dockerfile in the package
v1.0.0
Initial release
Metadata
Slug deep-scraper
Version 1.0.1
License
All-time Installs 0
Active Installs 0
Total Versions 2
Frequently Asked Questions

What is Deep Scraper?

Performs deep scraping of complex sites like YouTube using containerized Crawlee, extracting validated, ad-free transcripts and content as JSON output. It is an AI Agent Skill for Claude Code / OpenClaw, with 12384 downloads so far.

How do I install Deep Scraper?

Run "/install deep-scraper" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.

Is Deep Scraper free?

Yes, Deep Scraper is completely free (open-source). You can download, install and use it at no cost.

Which platforms does Deep Scraper support?

Deep Scraper is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).

Who created Deep Scraper?

It is built and maintained by opsun (@opsun); the current version is v1.0.1.

💬 Comments