← Back to Skills Marketplace
1964
Downloads
0
Stars
12
Active Installs
1
Versions
Install in OpenClaw
/install xpr-web-scraping
Description
Tools for fetching and extracting cleaned text, metadata, and links from single or multiple web pages with format options and link filtering.
Usage Guidance
This skill appears to be a coherent, self-contained web scraper that doesn't request secrets or install external code. Before installing: (1) review the full src/index.ts (the provided snippet was truncated) to confirm there are no hidden network callbacks or logging endpoints; (2) ensure use complies with target sites' robots.txt, terms of service, and legal/privacy rules; (3) enforce rate limits and avoid scraping protected or paywalled content; (4) if you run in a sensitive environment, sandbox the skill (or review for any unexpected outbound endpoints) before enabling autonomous invocation.
Capability Analysis
Type: OpenClaw Skill
Name: xpr-web-scraping
Version: 0.2.11
The skill provides web scraping functionality using Node.js built-in fetch. While the code is generally well-behaved and lacks direct evidence of malicious intent (e.g., no data exfiltration, persistence, or malicious execution), the `scrape_url` tool in `src/index.ts` allows arbitrary HTTP headers to be passed via the `headers` parameter. This capability, though plausibly needed for advanced scraping, presents a risky vector for misuse by a malicious prompt. An attacker could instruct the agent to send crafted headers for various attack scenarios against the target web server (e.g., authentication bypass, HTTP header injection, or to trigger specific server-side behaviors), making it a 'risky capability without clear malicious intent'.
Capability Assessment
Purpose & Capability
Name/description (fetching, extracting text/links/metadata) match the actual tools and code: scrape_url, extract_links, scrape_multiple. No unrelated env vars, binaries, or services are requested.
Instruction Scope
SKILL.md describes limited scraping actions (single page, link extraction, multi-page up to 10). Instructions recommend rate-limiting and content-size limits and do not instruct access to unrelated files, credentials, or external endpoints beyond the target pages.
Install Mechanism
No install spec; skill is instruction-plus-code and relies on built-in Node fetch. No downloads, package registry installs, or archive extraction are present in the provided metadata.
Credentials
Skill requires no environment variables, credentials, or config paths. The code uses only network fetch and in-memory parsing; requested access is proportional to web-scraping functionality.
Persistence & Privilege
always is false and disable-model-invocation is false (normal). The skill does not request persistent system-wide privileges or modify other skills. Autonomous invocation is allowed by platform default but not combined with other red flags.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install xpr-web-scraping - After installation, invoke the skill by name or use
/xpr-web-scraping - Provide required inputs per the skill's parameter spec and get structured output
Version History
v0.2.11
- Added SKILL.md documentation detailing available web scraping tools and usage guidelines.
- Described supported actions: single-page scraping, link extraction, and multi-page scraping.
- Clarified content formats (text, markdown, html) and their recommended uses.
- Provided best practices for scraping frequency, file size limits, and saving results.
Metadata
Frequently Asked Questions
What is XPR Web Scraping?
Tools for fetching and extracting cleaned text, metadata, and links from single or multiple web pages with format options and link filtering. It is an AI Agent Skill for Claude Code / OpenClaw, with 1964 downloads so far.
How do I install XPR Web Scraping?
Run "/install xpr-web-scraping" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is XPR Web Scraping free?
Yes, XPR Web Scraping is completely free (open-source). You can download, install and use it at no cost.
Which platforms does XPR Web Scraping support?
XPR Web Scraping is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created XPR Web Scraping?
It is built and maintained by paulgnz (@paulgnz); the current version is v0.2.11.
More Skills