← Back to Skills Marketplace
Web Scraper Skill
by
Abhishekj9621
· GitHub ↗
· v1.0.0
· MIT-0
136
Downloads
0
Stars
1
Active Installs
1
Versions
Install in OpenClaw
/install web-scraper-skill
Description
Use this skill to scrape, crawl, or extract data from websites using Apify or Firecrawl APIs. Trigger whenever the user wants to: scrape a URL, crawl a websi...
Usage Guidance
This skill appears to do what it claims (drive Apify and Firecrawl). Before installing or using it, consider: (1) the agent will send URLs and scraped page content to third-party services — do not send private, behind-auth, or sensitive pages unless you trust those services and have permission; (2) the skill will ask you for API keys at runtime — treat those keys like secrets (use least-privilege tokens, rotate/revoke if needed, and avoid sharing long-lived account-wide keys); (3) if you don't want the agent to autonomously make scraping requests, restrict its ability to invoke the skill or require explicit confirmation before running; and (4) verify legal/robots/terms-of-service constraints for sites you plan to scrape.
Capability Analysis
Type: OpenClaw Skill
Name: web-scraper-skill
Version: 1.0.0
The web-scraper-skill bundle provides legitimate documentation and code templates for integrating with the Firecrawl and Apify web scraping platforms. The instructions in SKILL.md and the code in references/code-templates.md are consistent with the stated purpose, use official API endpoints (api.firecrawl.dev and api.apify.com), and correctly instruct the agent to request API keys from the user rather than attempting to exfiltrate them.
Capability Assessment
Purpose & Capability
Name and description match the SKILL.md and code templates: the skill is explicitly for driving Apify and Firecrawl APIs to scrape/crawl web pages. It does not request unrelated binaries, config paths, or credentials in the registry metadata.
Instruction Scope
Runtime instructions and templates focus on calling Firecrawl and Apify endpoints, starting/polling jobs, and saving results. They include concrete HTTP examples and code templates that post URLs and receive scraped content. The SKILL.md does not warn about sending potentially sensitive/private site content to third-party APIs (data exfiltration risk), and it instructs the agent to always use this skill for scraping tasks — which could cause automatic outbound requests if combined with autonomous invocation.
Install Mechanism
Instruction-only skill (no install spec, no code files executed on install). This is the lowest-risk install model — nothing is pulled or executed at install time.
Credentials
The registry lists no required environment variables, but the SKILL.md clearly expects the user to provide Firecrawl and Apify API keys at runtime. That is proportionate to the purpose (those APIs require keys), but the skill does not declare or manage any required env vars up-front which could be confusing. It does not request unrelated credentials.
Persistence & Privilege
always:false (normal). disable-model-invocation:false allows autonomous invocation (platform default). This is expected for a skill that performs network calls, but users should be aware that the agent could call the external APIs without additional prompts when it decides scraping is required.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install web-scraper-skill - After installation, invoke the skill by name or use
/web-scraper-skill - Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.0
Initial release of the web-scraper-skill for website data extraction using Apify and Firecrawl APIs.
- Enables scraping, crawling, and mapping of websites, and extracting data and content in various formats.
- Supports both Firecrawl (single-page and site-wide scraping, markdown output) and Apify (specialized/pre-built actors for social, e-commerce, maps, etc.).
- Provides quick decision guidance for choosing the appropriate API based on user needs.
- Includes authentication instructions, API references, and example code patterns for common tasks.
- Outlines best practices and error handling for robust web data extraction workflows.
Metadata
Frequently Asked Questions
What is Web Scraper Skill?
Use this skill to scrape, crawl, or extract data from websites using Apify or Firecrawl APIs. Trigger whenever the user wants to: scrape a URL, crawl a websi... It is an AI Agent Skill for Claude Code / OpenClaw, with 136 downloads so far.
How do I install Web Scraper Skill?
Run "/install web-scraper-skill" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Web Scraper Skill free?
Yes, Web Scraper Skill is completely free, licensed under MIT-0. You can download, install and use it at no cost.
Which platforms does Web Scraper Skill support?
Web Scraper Skill is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created Web Scraper Skill?
It is built and maintained by Abhishekj9621 (@abhishekj9621); the current version is v1.0.0.
More Skills