← Back to Skills Marketplace
XCrawl Scraper
by
zhangss110
· GitHub ↗
· v1.0.0
· MIT-0
412
Downloads
0
Stars
0
Active Installs
1
Versions
Install in OpenClaw
/install xcrawl-scraper
Description
XCrawl - AI-Powered Web Scraping API / AI 驱动网页爬虫，支持结构化数据提取
Usage Guidance
This skill appears to be what it says: a client wrapper for the XCrawl scraping API. Before installing or running it: 1) Verify the xcrawl Python package (source repository, PyPI record) to ensure you trust the package and author; 2) Be aware the scraper sends page data to the XCrawl service (apiUrl run.xcrawl.com) — avoid using it with credentials or pages containing sensitive personal or proprietary data unless you trust the provider and its privacy policy; 3) The API key you set is stored in scripts/config.json inside the skill directory—treat it like any secret and don't check it into public repositories; 4) Installing via pip pulls third‑party code (supply‑chain risk), so prefer inspecting the package source first; 5) Confirm that crawling targets comply with terms of service and robots.txt. If you want extra assurance, review the xcrawl SDK source code and the network endpoints it contacts before use.
Capability Analysis
Type: OpenClaw Skill
Name: xcrawl-scraper
Version: 1.0.0
The XCrawl Scraper skill is a legitimate wrapper for the XCrawl AI-powered web scraping API. The Python script (scripts/xcrawl_scraper.py) provides standard functionality for scraping, searching, and mapping websites by interfacing with an external API (run.xcrawl.com). No evidence of data exfiltration, malicious execution, or prompt injection was found.
Capability Assessment
Purpose & Capability
Name/description match the actual behavior: the files implement a Python client wrapper that calls an external XCrawl API (scrape/search/map/crawl). Required binaries (python, pip) and the xcrawl SDK are appropriate for a Python scraper client.
Instruction Scope
SKILL.md instructs installing the xcrawl SDK, configuring an API key, and running the included script. The runtime instructions and the script only access the included config.json and the XCrawl network endpoint (apiUrl). The instructions do not attempt to read unrelated host files or environment variables.
Install Mechanism
There is no automated install spec; SKILL.md recommends pip install xcrawl. Using pip is typical for Python SDKs but carries the usual supply‑chain risk of third‑party packages—verify the 'xcrawl' package source (PyPI/GitHub) before installing.
Credentials
No environment variables or unrelated credentials are requested. The only secret is an API key that the user explicitly sets via the provided set-key command and which is stored in scripts/config.json — behaviour consistent with a cloud scraping API client.
Persistence & Privilege
The skill is not always-enabled and does not request elevated or cross-skill configuration. It persists only its own API key into scripts/config.json; autonomous invocation of the skill by the agent is allowed (platform default) but not excessive given the skill's function.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install xcrawl-scraper - After installation, invoke the skill by name or use
/xcrawl-scraper - Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.0
XCrawl Scraper 1.0.0 – Initial Release
- Launches an AI-powered web scraping tool supporting output in Markdown, HTML, JSON, and screenshots.
- Enables structured data extraction using JSON Schema.
- Features web crawling, site search, site mapping, and batch site scraping.
- Supports global proxy and easy configuration via command line.
- Provides simple installation and usage instructions for quick setup.
Metadata
Frequently Asked Questions
What is XCrawl Scraper?
XCrawl - AI-Powered Web Scraping API / AI 驱动网页爬虫，支持结构化数据提取. It is an AI Agent Skill for Claude Code / OpenClaw, with 412 downloads so far.
How do I install XCrawl Scraper?
Run "/install xcrawl-scraper" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is XCrawl Scraper free?
Yes, XCrawl Scraper is completely free, licensed under MIT-0. You can download, install and use it at no cost.
Which platforms does XCrawl Scraper support?
XCrawl Scraper is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created XCrawl Scraper?
It is built and maintained by zhangss110 (@zhangss110); the current version is v1.0.0.
More Skills