← Back to Skills Marketplace
48
Downloads
0
Stars
0
Active Installs
1
Versions
Install in OpenClaw
/install scraper-pro
Description
Extract data from websites and APIs for analysis. Use when user needs to collect product prices from e-commerce sites, gather news articles, extract structur...
Usage Guidance
This skill contains an executable Python scraper but the documentation overstates its capabilities (login, click-style pagination, XPath) which the script does not implement — treat those docs as inaccurate. Before using: (1) inspect or run the script in a safe sandbox; (2) do not pass credentials or sensitive file paths to the tool (it will write files to paths you specify); (3) fix or remove the TLS verification bypass in fetch_page (re-enable certificate checks) unless you understand and accept the risk; (4) test scraping on non-sensitive, permitted sites and confirm legal/robots.txt compliance; (5) if you need authentication/pagination/XPath support, either extend the script yourself or obtain a tool that explicitly implements and documents those features.
Capability Analysis
Type: OpenClaw Skill
Name: scraper-pro
Version: 1.0.0
The skill bundle contains a web scraping script (scripts/scrape.py) that explicitly disables SSL certificate verification (ssl.CERT_NONE), which is a high-risk security vulnerability allowing for Man-in-the-Middle (MITM) attacks. Additionally, there is a discrepancy between the documentation (SKILL.md), which claims to support authentication and a '--login' flag, and the actual Python implementation which lacks these features. While these are significant flaws, they appear to be unintentional vulnerabilities rather than active malware.
Capability Assessment
Purpose & Capability
The name/description promise features (CSS/XPath selectors, pagination types including click, authentication/login support) that are not implemented in the included script. The SKILL.md shows a --login option and complex YAML pagination examples, but scripts/scrape.py does not accept a --login argument, does not implement click-based pagination, and does not implement XPath or robust selector parsing. This mismatch is incoherent and may mislead users about capabilities.
Instruction Scope
Runtime instructions tell the agent to run the bundled Python script with user-supplied URLs and output paths. The script performs network fetches and writes files but does not read other system files or environment variables. However, the code disables TLS certificate validation (ssl.CERT_NONE and check_hostname=False) when fetching pages, which weakens transport security and can enable MITM attacks; the SKILL.md and 'Best Practices' recommend checking robots.txt and respecting rate limits but do not disclose the TLS bypass. The documentation also references command-line options (--login) that are absent from the code.
Install Mechanism
No install spec; instruction-only with a small included Python script. Nothing is downloaded or written by an installer, which limits the installation attack surface.
Credentials
The skill requests no environment variables, credentials, or config paths. That is proportionate for a generic scraper. There is no evidence the code attempts to access other secrets or unrelated system configuration.
Persistence & Privilege
The skill is not always-enabled and does not request persistent system-wide privileges or modify other skills. It only runs when invoked and writes output files specified by the user.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install scraper-pro - After installation, invoke the skill by name or use
/scraper-pro - Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.0
Initial release
Metadata
Frequently Asked Questions
What is Data Scraper?
Extract data from websites and APIs for analysis. Use when user needs to collect product prices from e-commerce sites, gather news articles, extract structur... It is an AI Agent Skill for Claude Code / OpenClaw, with 48 downloads so far.
How do I install Data Scraper?
Run "/install scraper-pro" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Data Scraper free?
Yes, Data Scraper is completely free, licensed under MIT-0. You can download, install and use it at no cost.
Which platforms does Data Scraper support?
Data Scraper is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created Data Scraper?
It is built and maintained by BIN (@dinghaibin); the current version is v1.0.0.
More Skills