← Back to Skills Marketplace
6257
Downloads
5
Stars
101
Active Installs
6
Versions
Install in OpenClaw
/install scrapling
Description
Adaptive web scraping framework with anti-bot bypass and spider crawling.
Usage Guidance
Install only after reviewing the helper script and limiting use to sites where you have permission to scrape. Avoid passing untrusted URLs, selectors, or spider files to run.sh, use an isolated virtual environment, and do not use the API-replication or bypass examples against paid, protected, rate-limited, or terms-prohibited services.
Capability Analysis
Type: OpenClaw Skill
Name: scrapling
Version: 1.0.8
The skill bundle is classified as suspicious due to critical shell injection and arbitrary code execution vulnerabilities in the `run.sh` script. Specifically, the `fetch` and `stealth` modes directly interpolate user-supplied `$URL` and `$SELECTOR` into `python3 -c` commands without sanitization, allowing for arbitrary Python code or shell command injection. The `spider` mode is even more severe, directly executing the `$URL` argument as a Python script (`python3 "$URL"`), which is a clear arbitrary code execution risk. While the `SKILL.md` documentation describes powerful web scraping and API reverse engineering techniques (including Cloudflare bypass and auth token discovery) that could be misused, it presents them as a methodology rather than explicit instructions for malicious activity. The vulnerabilities in `run.sh` are implementation flaws, not evidence of intentional malice within the skill's stated purpose.
Capability Assessment
Purpose & Capability
Web scraping, crawling, and browser fetching fit the stated purpose, but the skill also teaches hidden/premium API discovery, auth-header or token replication, and Cloudflare bypass in ways that exceed ordinary compliant scraping.
Instruction Scope
The documentation says not to use login-protected, paywalled, or TOS-prohibited sites, but later gives operational steps for finding premium endpoints, extracting client-side auth logic, and replaying requests.
Install Mechanism
run.sh automatically installs the unpinned scrapling package if missing, and install mode pulls scrapling[all] plus browser setup, modifying the local Python environment without a clear explicit install boundary.
Credentials
Outbound requests are expected for this skill, but run.sh interpolates URL and selector input into python3 -c code and spider mode directly runs a caller-supplied Python file, making the helper broader than scraping.
Persistence & Privilege
No hidden background persistence, credential theft, or destructive behavior was found, but package/browser installation persists locally and spider execution runs arbitrary Python with the user's normal privileges.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install scrapling - After installation, invoke the skill by name or use
/scrapling - Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.8
v1.0.8 - Firecrawl-Style Crawl
v1.0.5
Enhanced API reverse engineering methodology with detailed step-by-step process from @paoloanzn. Added Solscan case study. Updated credits.
v1.0.1
scrapling v1.0.1
- Added _meta.json metadata file.
- Updated SKILL.md to adjust requirements: removed "pip" from required bins.
- Minor updates to run.sh and metadata structure.
v1.2.0
Full features except MCP - CLI, adaptive, spider
v1.1.0
Add agent instructions and credits
v1.0.0
Initial release - adaptive web scraping with anti-bot bypass and spider crawling
Metadata
Frequently Asked Questions
What is Scrapling?
Adaptive web scraping framework with anti-bot bypass and spider crawling. It is an AI Agent Skill for Claude Code / OpenClaw, with 6257 downloads so far.
How do I install Scrapling?
Run "/install scrapling" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Scrapling free?
Yes, Scrapling is completely free (open-source). You can download, install and use it at no cost.
Which platforms does Scrapling support?
Scrapling is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created Scrapling?
It is built and maintained by ohnednez (@zendenho7); the current version is v1.0.8.
More Skills