← Back to Skills Marketplace
386
Downloads
0
Stars
0
Active Installs
1
Versions
Install in OpenClaw
/install website-scraper-pro
Description
Run a local script to scrape a single web page into clean markdown or deterministic JSON with Crawl4AI. Use when: user needs direct page retrieval from a URL...
Usage Guidance
This skill appears to do what it says: run a local Crawl4AI scraper for a single URL. Before installing or running it, check that the 'uv' binary on your system is the trusted tool you expect (it will execute the inline script block and install Python packages), and confirm you are comfortable having the 'crawl4ai' package and (optionally) Playwright download browser binaries (chromium) at runtime. Avoid scraping sensitive internal URLs. If you need stricter control, review the included Python files locally and run the script in an isolated environment before granting it broader agent access.
Capability Analysis
Type: OpenClaw Skill
Name: website-scraper-pro
Version: 0.1.0
The skill is a legitimate tool designed to scrape single web pages into markdown or JSON using the Crawl4AI library. It includes standard configurations for handling JavaScript-heavy pages and deterministic query-based content filtering. No evidence of malicious intent, data exfiltration, or unauthorized execution was found across the codebase (e.g., src/main.py, src/service.py).
Capability Assessment
Purpose & Capability
Name/description, CLI flags, required binary 'uv', and included Python code all align: the skill runs a local Crawl4AI-based scraper for a single URL. No unexpected credentials, system paths, or unrelated binaries are requested.
Instruction Scope
SKILL.md instructs running the bundled script via 'uv run'. The code fetches only the target URL, processes page HTML into markdown/JSON, and normalizes links. It does not read arbitrary host files or environment variables, nor does it post scraped data to external endpoints. It does suppress crawler stdout/stderr and handles browser-setup errors as expected.
Install Mechanism
Registry has no install spec, but main.py contains an inline script header that 'uv run' will use to install the 'crawl4ai' dependency into an isolated environment. This is coherent for a bundled script, but it means network package installation will occur at runtime — verify you trust the package source and the 'uv' tool that performs the install.
Credentials
No environment variables, credentials, or config paths are requested. The tool asks only for a URL and optional flags, which is proportionate to its function.
Persistence & Privilege
The skill is not always-enabled and does not request elevated or persistent system privileges or modify other skills' configurations. Autonomous invocation by the agent is allowed (default) and consistent with normal skill behavior.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install website-scraper-pro - After installation, invoke the skill by name or use
/website-scraper-pro - Provide required inputs per the skill's parameter spec and get structured output
Version History
v0.1.0
Initial release of Website Scraper Pro.
- Scrape a single web page into clean markdown or deterministic JSON using Crawl4AI.
- Supports JS-aware scraping for client-side rendered pages.
- Deterministic, query-focused narrowing of content without internal AI processing.
- Outputs either markdown or structured JSON including title, links, and metadata.
- Usage is limited to single-page extraction; no site-wide crawling or web search.
Metadata
Frequently Asked Questions
What is Website Scraper Pro?
Run a local script to scrape a single web page into clean markdown or deterministic JSON with Crawl4AI. Use when: user needs direct page retrieval from a URL... It is an AI Agent Skill for Claude Code / OpenClaw, with 386 downloads so far.
How do I install Website Scraper Pro?
Run "/install website-scraper-pro" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Website Scraper Pro free?
Yes, Website Scraper Pro is completely free, licensed under MIT-0. You can download, install and use it at no cost.
Which platforms does Website Scraper Pro support?
Website Scraper Pro is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created Website Scraper Pro?
It is built and maintained by youpele52 (@youpele52); the current version is v0.1.0.
More Skills