← Back to Skills Marketplace
10oss

Skrape

by X · GitHub ↗ · v1.1.1 · MIT-0
cross-platform ✓ Security Clean
279
Downloads
0
Stars
0
Active Installs
3
Versions
Install in OpenClaw
/install skrape
Description
Ethical web data extraction with robots exclusion protocol adherence, throttled scraping requests, and privacy-compliant handling ("Scrape responsibly!").
Usage Guidance
This appears to be a coherent, instruction-only scraper helper. Before you use it in production: (1) Treat code.md as example patterns, not a drop-in library — the workflow references require('./scrape') which isn't provided and robots parsing is simplified. (2) Replace the example contact email with a real contact or remove it as appropriate. (3) Consider tightening robots handling (be conservative on errors instead of assuming permission) and improve robots.txt parsing for complex rules. (4) Never feed or persist sensitive credentials or personal data unless you have lawful basis; the SKILL.md already warns about PII/GDPR. (5) If you incorporate the example into your system, review the code for correctness, add limits and audit controls, and run it in a controlled environment. Overall, there are no red flags that contradict the stated purpose.
Capability Analysis
Type: OpenClaw Skill Name: skrape Version: 1.1.1 The 'Skrape' skill bundle is a well-documented and ethically designed web scraping utility. The code in code.md implements standard best practices including robots.txt verification, request throttling, exponential backoff for server errors, and proper handling of 429 rate-limit responses. The SKILL.md instructions explicitly guide the AI agent to respect copyright, privacy (GDPR/CCPA), and site-specific terms of service, showing no signs of malicious intent or prompt injection.
Capability Assessment
Purpose & Capability
Name/description match the contents: SKILL.md and code.md focus on robots.txt checks, throttling/backoff, and privacy guidance. There are no unrelated env vars, binaries, or opaque network endpoints requested.
Instruction Scope
Runtime instructions stay within scraping responsibilities (check robots, prefer APIs, throttle, avoid PII). The example code is illustrative and consistent, but contains implementation simplifications (e.g., treating missing robots.txt and fetch errors as 'permitted', a basic robots.txt evaluator that may not fully implement precedence/longest-match rules). These are functional caveats rather than malicious behavior.
Install Mechanism
This is instruction-only with no install spec and no external downloads — lowest surface area. The code examples only use Node built-ins (http/https/url/console/process).
Credentials
No credentials, env vars, or config paths are requested. The sample uses a contact email in the User-Agent, which is appropriate for polite scraping but not a secret.
Persistence & Privilege
always is false and the skill does not request persistent or cross-skill privileges. It does not modify system or other-skill configs.
How to Use
  1. Make sure OpenClaw is installed (local or Docker)
  2. Run the install command in chat: /install skrape
  3. After installation, invoke the skill by name or use /skrape
  4. Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.1.1
- Removed implementation and test files (`index.js`, `test.js`). - No changes to documentation or skill description. - Codebase now lacks executable or testable functionality; only guidance remains.
v1.1.0
- Added emphasis on respecting creative work, including not copying design or substantial text and properly attributing sources. - Updated documentation (SKILL.md) to include new "Respect Creative Work" section. - Improved clarity around copyright, ethical use, and creator impact. - Added initial code files: index.js and test.js.
v1.0.0
- Initial release of Skrape, a Node.js/JavaScript tool for ethical web data extraction. - Implements strict robots.txt checks and adherence to platforms' terms before extracting any data. - Differentiates handling of public vs. personal data, with GDPR/CCPA safeguards for personal information. - Includes request throttling, compliance with HTTP status codes, and mandatory use of authentic identification in requests. - Enforces data minimization, prompt purging of personal information, and event logging for transparency. - Includes a clear operational code of conduct and compliance guidance in documentation.
Metadata
Slug skrape
Version 1.1.1
License MIT-0
All-time Installs 0
Active Installs 0
Total Versions 3
Frequently Asked Questions

What is Skrape?

Ethical web data extraction with robots exclusion protocol adherence, throttled scraping requests, and privacy-compliant handling ("Scrape responsibly!"). It is an AI Agent Skill for Claude Code / OpenClaw, with 279 downloads so far.

How do I install Skrape?

Run "/install skrape" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.

Is Skrape free?

Yes, Skrape is completely free, licensed under MIT-0. You can download, install and use it at no cost.

Which platforms does Skrape support?

Skrape is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).

Who created Skrape?

It is built and maintained by X (@10oss); the current version is v1.1.1.

💬 Comments