← Back to Skills Marketplace
Scrapling Official Skill
by
Karim shoair
· GitHub ↗
· v0.5.0
· MIT-0
15150
Downloads
28
Stars
0
Active Installs
16
Versions
Install in OpenClaw
/install scrapling-official
Description
Scrape web pages using Scrapling with HTTP requests, stealth browsers, JavaScript rendering, browser actions, API response capture, concurrent spiders, and adaptive parsing. Use when asked to scrape, crawl, or extract data from websites; web_fetch fails; the site has anti-bot protections; write Pyth
Usage Guidance
Install this only if you intentionally need a powerful scraping/browser automation tool. Pin package or Docker versions where possible, scrape only sites you are authorized to access, avoid passing real cookies or proxy credentials unless necessary, clear local state/caches when done, and do not expose the MCP HTTP server without authentication and TLS.
Capability Assessment
Credentials
Python, browser automation, network access, cookies, proxy settings, and optional MCP server exposure are proportionate for a scraping framework. The MCP reference documents authentication and warns against unauthenticated network exposure.
Install Mechanism
Installation uses pip plus Scrapling's browser installer, and optional Docker commands. The Docker examples use mutable images including latest, so users should pin versions or digests, but no hidden installer, autorun hook, or bundled malicious code was found in the skill artifact.
Instruction Scope
Invocation guidance is broad for scraping and crawl/code-generation tasks, but the instructions stay within that domain and include guardrails to scrape only authorized content, respect robots.txt and ToS, avoid paywalls/auth bypass without permission, and avoid personal or sensitive data.
Persistence & Privilege
Persistence is user-directed and documented: browser sessions can remain open, state files can save cookies/local storage, network history can be retained within a session, and spiders can write checkpoints or development caches. The docs warn to close sessions and not ship development caching enabled.
Purpose & Capability
The skill is explicitly for Scrapling web scraping, including HTTP requests, stealth browser automation, JavaScript rendering, API capture, spiders, proxies, and Cloudflare handling; these are high-capability features but are disclosed and aligned with the stated purpose.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install scrapling-official - After installation, invoke the skill by name or use
/scrapling-official - Provide required inputs per the skill's parameter spec and get structured output
Version History
v0.5.0
Version 0.5.0 introduces updated browser session handling and simplifies browser scraping options.
- Added new browser session example (examples/02_browser_session.py)
- Removed dynamic session example and deprecated fetching documentation
- Updated CLI to use a unified "fetch" command for browser automation and anti-bot protection
- Improved documentation for usage, CLI commands, and adaptive scraping
- Revised references and examples to match new usage patterns and removed outdated details
v0.4.15
- Updated to version 0.4.15.
- Added a new reference document: references/building-rag-systems.md.
- Removed the old skill card file: skill-card.md.
- Minimum required version for setup now uses "scrapling[all]>=0.4.15".
v0.4.14
scrapling-official 0.4.14
- Updated to require and document usage of scrapling version 0.4.14.
- Removed the skill-card.md file from the repository.
- No user-facing functional changes to features or commands.
v0.4.13
- Updated dependency requirement to scrapling version 0.4.13.
- Removed the redundant skill-card.md file for simplification.
v0.4.12
- Updated dependency installation instructions to require scrapling version 0.4.12 or greater.
- Removed unnecessary sample file: skill-card.md.
- No user-facing functional changes.
v0.4.11
Version 0.4.11 of scrapling-official:
- Updated required version in documentation to 0.4.11.
- Added new reference file: references/spiders/platform-templates.md.
- Removed obsolete file: skill-card.md.
v0.4.10
scrapling-official v0.4.10
- Updated SKILL.md to require and document installation with scrapling[all]>=0.4.10.
- Added new integration documentation: references/integrations/scrapy.md.
- Removed outdated file: skill-card.md.
- Improved and updated various documentation files (examples/README.md, references/fetching/stealthy.md, references/mcp-server.md).
v0.4.9
scrapling-official 0.4.9
- Updated documentation to require installing version 0.4.9+.
- Removed skill-card.md file.
- General documentation and reference file improvements and updates.
v0.4.8
scrapling-official v0.4.8
- Updated documentation across multiple fetching and parsing reference files.
- Added a new reference page for generic spider templates.
- CLI installation instructions now recommend using "scrapling[all]>=0.4.8".
- General improvements to documentation for setup, usage, and examples.
v0.4.7
- Updated minimum required version to Scrapling 0.4.7 in setup instructions.
- Version bump to 0.4.7 in all documentation.
- Minor documentation updates and clarification in SKILL.md, examples, and references.
v0.4.6
scrapling-official 0.4.6
- Added automatic ad blocking when using the --ai-targeted flag with browser commands.
- Updated documentation to reflect the new ad blocking behavior with --ai-targeted.
- Changed minimum required version: now requires scrapling[all]>=0.4.6 in setup instructions.
v0.4.5
scrapling-official 0.4.5
- Updated documentation for command-line options, especially `--follow-redirects` (now defaults to "safe", which rejects internal/private IP redirects).
- Increased minimum required scrapling library version to 0.4.5.
- Improved and clarified several reference and example docs.
- Various minor documentation corrections and enhancements.
v0.4.4
scrapling-official 0.4.4
- Updated documentation links and references to version 0.4.4.
- Improved and clarified getting started and architecture docs for spiders.
- Enhanced example and advanced usage documentation for easier onboarding.
- No feature or breaking changes; documentation quality and version alignment improved.
v0.4.3
Version 0.4.3 of scrapling-official — notable improvements and additions:
- Added explicit instructions and argument (--ai-targeted) for safer AI context scraping.
- Updated requirements to "scrapling[all]>=0.4.3" and clarified package metadata.
- Improved documentation, setup instructions, and security-focused usage notes.
- Enhanced CLI option descriptions, including a new --ai-targeted switch for content sanitization.
- Expanded and revised reference/example docs for up-to-date scraping practices.
v0.4.2
- Updated minimum required Scrapling version to 0.4.2 in installation instructions.
- Changed license from "Complete terms in LICENSE.txt" to explicit BSD-3-Clause in metadata.
- Documentation and references improved across usage guides (examples, references/).
- No breaking changes to usage or CLI interfaces.
v0.4.1
scrapling-official 0.4.1
- New official documentation (SKILL.md) clarifying features, setup, and usage patterns.
- Highlights adaptive, stealthy web scraping with anti-bot bypass (Cloudflare Turnstile), JavaScript rendering, and scalable crawling/spiders.
- Provides CLI commands for HTTP methods, browser automation, and content extraction using CSS selectors.
- Documents key options for HTTP/browsing, including headers, proxies, selectors, authentication, and stealth features.
- Includes setup instructions for Python and Docker environments.
Metadata
Frequently Asked Questions
What is Scrapling Official Skill?
Scrape web pages using Scrapling with HTTP requests, stealth browsers, JavaScript rendering, browser actions, API response capture, concurrent spiders, and adaptive parsing. Use when asked to scrape, crawl, or extract data from websites; web_fetch fails; the site has anti-bot protections; write Pyth. It is an AI Agent Skill for Claude Code / OpenClaw, with 15150 downloads so far.
How do I install Scrapling Official Skill?
Run "/install scrapling-official" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Scrapling Official Skill free?
Yes, Scrapling Official Skill is completely free, licensed under MIT-0. You can download, install and use it at no cost.
Which platforms does Scrapling Official Skill support?
Scrapling Official Skill is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created Scrapling Official Skill?
It is built and maintained by Karim shoair (@d4vinci); the current version is v0.5.0.
More Skills