← Back to Skills Marketplace
opsun

Deep Scraper

by opsun · GitHub ↗ · v1.0.1
cross-platform ⚠ suspicious
12627
Downloads
10
Stars
0
Active Installs
2
Versions
Install in OpenClaw
/install deep-scraper
Description
Performs deep scraping of complex sites like YouTube using containerized Crawlee, extracting validated, ad-free transcripts and content as JSON output.
Usage Guidance
Review before installing. Only run this skill against URLs you are authorized to scrape, and avoid using it in environments where the container can reach private services, cloud metadata endpoints, intranet sites, or sensitive local web apps. Prefer adding strict URL allowlists, private-network blocking, redirect validation, pinned dependencies, and a complete pinned Docker build before use.
Capability Analysis
Type: OpenClaw Skill Name: deep-scraper Version: 1.0.1 The skill bundle is classified as benign. It implements a web scraper using Docker, Crawlee, and Playwright, which aligns with its stated purpose of 'deep web scraping' and 'penetrating protections' on complex websites. While it utilizes Docker and runs Playwright with `--no-sandbox` (a common requirement for Playwright in Docker that reduces in-container security), these capabilities are plausibly needed for its function. The code in `assets/main_handler.js` and `assets/youtube_handler.js` focuses on scraping public web content, outputs results to stdout, clears cookies to prevent session leakage, and does not exhibit any signs of data exfiltration, malicious execution, persistence, prompt injection against the agent, or obfuscation. The `SKILL.md` explicitly forbids scraping password-protected or non-public personal information, indicating a consideration for privacy.
Capability Assessment
⚠ Credentials
A containerized browser is proportionate for dynamic-page scraping, but unrestricted browser navigation from the container is broader than needed and can turn the container's network position into an unintended data source.
ℹ Install Mechanism
Installation is manual and Docker-based, with a local assets volume and --rm container cleanup. The documented image tag is local but unpinned, and the artifact references a Dockerfile that is not present in the inspected package.
⚠ Instruction Scope
The instructions disclose Docker, browser automation, scraping, and raw interception, but they do not scope scraping to authorized public targets beyond a general privacy rule, and the implementation can navigate to non-YouTube generic URLs and print page text.
ℹ Persistence & Privilege
No durable service, scheduler, backdoor, or host persistence was found. The scripts clear browser cookies inside the Playwright context and run with Chromium sandbox-disabling flags for Docker, which increases runtime exposure but is not persistence.
⚠ Purpose & Capability
The stated purpose is deep scraping with Playwright/Crawlee, and the code does scrape YouTube transcripts/descriptions and generic page text; however, the same capability is exposed for arbitrary TARGET_URL values with no scheme, host, private-IP, redirect, or destination validation.
How to Use
  1. Make sure OpenClaw is installed (local or Docker)
  2. Run the install command in chat: /install deep-scraper
  3. After installation, invoke the skill by name or use /deep-scraper
  4. Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.1
Included Dockerfile in the package
v1.0.0
Initial release
Metadata
Slug deep-scraper
Version 1.0.1
License —
All-time Installs 0
Active Installs 0
Total Versions 2
Frequently Asked Questions

What is Deep Scraper?

Performs deep scraping of complex sites like YouTube using containerized Crawlee, extracting validated, ad-free transcripts and content as JSON output. It is an AI Agent Skill for Claude Code / OpenClaw, with 12627 downloads so far.

How do I install Deep Scraper?

Run "/install deep-scraper" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.

Is Deep Scraper free?

Yes, Deep Scraper is completely free (open-source). You can download, install and use it at no cost.

Which platforms does Deep Scraper support?

Deep Scraper is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).

Who created Deep Scraper?

It is built and maintained by opsun (@opsun); the current version is v1.0.1.

💬 Comments