← Back to Skills Marketplace
Scrapling Official Skill
by
Karim shoair
· GitHub ↗
· v0.4.15
· MIT-0
14114
Downloads
28
Stars
0
Active Installs
15
Versions
Install in OpenClaw
/install scrapling-official
Description
Scrape web pages using Scrapling with anti-bot bypass (like Cloudflare Turnstile), stealth headless browsing, spiders framework, adaptive scraping, and JavaScript rendering. Use when asked to scrape, crawl, or extract data from websites; web_fetch fails; the site has anti-bot protections; write Pyth
Usage Guidance
Install only if you specifically need a powerful scraping/crawling tool and are prepared to keep its use limited to sites you own or are authorized to scrape. Avoid using the stealth, Cloudflare-solving, proxy rotation, DELETE/PUT/POST, remote CDP, persistent browser profile, and response-cache features unless you understand the legal, account, and data-retention impact. Do not use it for paywalls, authenticated areas without permission, personal data, or broad unsupervised crawling.
Capability Assessment
Credentials
Network access, browser automation, custom browser executables, local Chrome use, remote CDP browser control, cookies, proxy credentials, and MCP exposure are all documented, but they are high-impact and not tightly destination-scoped.
Install Mechanism
Installation is disclosed as pip installing scrapling with extras plus running scrapling install --force to download browser dependencies, with Docker image alternatives. I found no hidden installer, obfuscated command, or persistence setup in the artifact files.
Instruction Scope
The skill is invoked for broad scrape/crawl/extract scenarios and recommends escalating to stealthy-fetch when blocked. It includes final guardrails to scrape only authorized content, respect robots.txt/ToS, avoid paywalls/authentication bypass, and avoid personal or sensitive data, but some high-risk examples appear before or away from that cautionary framing.
Persistence & Privilege
Persistent sessions, cookie/session reuse, user_data_dir support, crawl checkpoints, output files, and development response caches are documented. These are useful for scraping, but can retain sensitive scraped content or authenticated session material if users apply them to private targets.
Purpose & Capability
The stated purpose is web scraping, and most capabilities fit that purpose, but the artifacts explicitly promote stealth browsing, Cloudflare challenge solving, proxy use, and POST/PUT/DELETE requests against arbitrary URLs, which goes beyond low-risk content extraction.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install scrapling-official - After installation, invoke the skill by name or use
/scrapling-official - Provide required inputs per the skill's parameter spec and get structured output
Version History
v0.4.15
- Updated to version 0.4.15.
- Added a new reference document: references/building-rag-systems.md.
- Removed the old skill card file: skill-card.md.
- Minimum required version for setup now uses "scrapling[all]>=0.4.15".
v0.4.14
scrapling-official 0.4.14
- Updated to require and document usage of scrapling version 0.4.14.
- Removed the skill-card.md file from the repository.
- No user-facing functional changes to features or commands.
v0.4.13
- Updated dependency requirement to scrapling version 0.4.13.
- Removed the redundant skill-card.md file for simplification.
v0.4.12
- Updated dependency installation instructions to require scrapling version 0.4.12 or greater.
- Removed unnecessary sample file: skill-card.md.
- No user-facing functional changes.
v0.4.11
Version 0.4.11 of scrapling-official:
- Updated required version in documentation to 0.4.11.
- Added new reference file: references/spiders/platform-templates.md.
- Removed obsolete file: skill-card.md.
v0.4.10
scrapling-official v0.4.10
- Updated SKILL.md to require and document installation with scrapling[all]>=0.4.10.
- Added new integration documentation: references/integrations/scrapy.md.
- Removed outdated file: skill-card.md.
- Improved and updated various documentation files (examples/README.md, references/fetching/stealthy.md, references/mcp-server.md).
v0.4.9
scrapling-official 0.4.9
- Updated documentation to require installing version 0.4.9+.
- Removed skill-card.md file.
- General documentation and reference file improvements and updates.
v0.4.8
scrapling-official v0.4.8
- Updated documentation across multiple fetching and parsing reference files.
- Added a new reference page for generic spider templates.
- CLI installation instructions now recommend using "scrapling[all]>=0.4.8".
- General improvements to documentation for setup, usage, and examples.
v0.4.7
- Updated minimum required version to Scrapling 0.4.7 in setup instructions.
- Version bump to 0.4.7 in all documentation.
- Minor documentation updates and clarification in SKILL.md, examples, and references.
v0.4.6
scrapling-official 0.4.6
- Added automatic ad blocking when using the --ai-targeted flag with browser commands.
- Updated documentation to reflect the new ad blocking behavior with --ai-targeted.
- Changed minimum required version: now requires scrapling[all]>=0.4.6 in setup instructions.
v0.4.5
scrapling-official 0.4.5
- Updated documentation for command-line options, especially `--follow-redirects` (now defaults to "safe", which rejects internal/private IP redirects).
- Increased minimum required scrapling library version to 0.4.5.
- Improved and clarified several reference and example docs.
- Various minor documentation corrections and enhancements.
v0.4.4
scrapling-official 0.4.4
- Updated documentation links and references to version 0.4.4.
- Improved and clarified getting started and architecture docs for spiders.
- Enhanced example and advanced usage documentation for easier onboarding.
- No feature or breaking changes; documentation quality and version alignment improved.
v0.4.3
Version 0.4.3 of scrapling-official — notable improvements and additions:
- Added explicit instructions and argument (--ai-targeted) for safer AI context scraping.
- Updated requirements to "scrapling[all]>=0.4.3" and clarified package metadata.
- Improved documentation, setup instructions, and security-focused usage notes.
- Enhanced CLI option descriptions, including a new --ai-targeted switch for content sanitization.
- Expanded and revised reference/example docs for up-to-date scraping practices.
v0.4.2
- Updated minimum required Scrapling version to 0.4.2 in installation instructions.
- Changed license from "Complete terms in LICENSE.txt" to explicit BSD-3-Clause in metadata.
- Documentation and references improved across usage guides (examples, references/).
- No breaking changes to usage or CLI interfaces.
v0.4.1
scrapling-official 0.4.1
- New official documentation (SKILL.md) clarifying features, setup, and usage patterns.
- Highlights adaptive, stealthy web scraping with anti-bot bypass (Cloudflare Turnstile), JavaScript rendering, and scalable crawling/spiders.
- Provides CLI commands for HTTP methods, browser automation, and content extraction using CSS selectors.
- Documents key options for HTTP/browsing, including headers, proxies, selectors, authentication, and stealth features.
- Includes setup instructions for Python and Docker environments.
Metadata
Frequently Asked Questions
What is Scrapling Official Skill?
Scrape web pages using Scrapling with anti-bot bypass (like Cloudflare Turnstile), stealth headless browsing, spiders framework, adaptive scraping, and JavaScript rendering. Use when asked to scrape, crawl, or extract data from websites; web_fetch fails; the site has anti-bot protections; write Pyth. It is an AI Agent Skill for Claude Code / OpenClaw, with 14114 downloads so far.
How do I install Scrapling Official Skill?
Run "/install scrapling-official" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Scrapling Official Skill free?
Yes, Scrapling Official Skill is completely free, licensed under MIT-0. You can download, install and use it at no cost.
Which platforms does Scrapling Official Skill support?
Scrapling Official Skill is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created Scrapling Official Skill?
It is built and maintained by Karim shoair (@d4vinci); the current version is v0.4.15.
More Skills