← Back to Skills Marketplace
722
Downloads
0
Stars
2
Active Installs
1
Versions
Install in OpenClaw
/install spider
Description
Web scraping using Chrome + WebMCP. Primary method for all web crawling tasks.
Usage Guidance
This skill instructs the agent to control your host Chrome browser (start it, open pages, interact with tabs, change chrome://flags). That means it could access cookies, logged-in sessions, and other tabs unless the platform prevents that. Before installing: confirm you trust the skill source; ensure the platform restricts host-browser operations or runs the skill in a separate browser profile or sandbox; avoid running it while sensitive sessions are open; do not give it persistent/system-wide permissions without review. If you need only static pages, prefer a sandboxed fetch/web_fetch approach. If you decide to install, test it on non-sensitive sites first and review any platform prompts that grant browser control.
Capability Analysis
Type: OpenClaw Skill
Name: spider
Version: 1.0.0
The 'spider' skill is a web scraping tool designed to extract financial data from legitimate platforms like Tonghuashun, East Money, and Xueqiu using Chrome and WebMCP. While it requires enabling experimental browser flags and utilizes 'host' mode (which increases the attack surface compared to a sandbox), these actions are transparently documented as functional requirements for JavaScript rendering and interaction. There is no evidence of data exfiltration, malicious intent, or obfuscated code in SKILL.md or _meta.json.
Capability Assessment
Purpose & Capability
The skill's stated purpose (Chrome + WebMCP scraping) matches the instructions for opening pages, snapshots, and interactions. However, it assumes the ability to start and control the host Chrome instance and to enable experimental chrome://flags, yet declares no required binaries, extensions, or config paths. The omission of an explicit dependency on a controllable Chrome/browser environment is a minor coherence gap.
Instruction Scope
Runtime instructions direct the agent to run Chrome on the host (target="host"), start/stop it, open arbitrary URLs, interact with pages, and close other tabs. While necessary for scraping, these operations give the agent access to any currently open browser state (tabs, cookies, logged-in sessions) and could expose private data. The SKILL.md does not limit what browser state may be read (cookies, other tabs) nor explicitly forbid accessing user data outside the target pages.
Install Mechanism
There is no install spec and no code files; this is instruction-only, so nothing is written to disk by the skill itself. That lowers supply-chain risk. The lack of an install step means the skill relies on platform/browser capabilities to perform actions.
Credentials
The skill requests no environment variables or credentials, which is appropriate. However, it implicitly relies on the host browser and its session state (cookies/auth) — a source of sensitive data that isn't declared or constrained in the metadata.
Persistence & Privilege
always: false and standard autonomous invocation are fine. The bigger issue is the explicit recommendation to use target="host" for every task; combined with autonomous invocation this increases the potential blast radius because the agent can act in the user's interactive browser context unless the platform prevents it.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install spider - After installation, invoke the skill by name or use
/spider - Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.0
Spider 1.0.0 — Default web scraping skill using Chrome + WebMCP
- Introduces a new web scraping method that replaces older approaches like web_fetch.
- Supports scraping from common finance and news sites, e.g., 同花顺 (Tonghuashun), 东方财富 (East Money), 雪球 (Xueqiu), and 百度 (Baidu).
- Provides structured trigger keywords and usage examples for various data extraction tasks.
- Includes step-by-step operational flow: Chrome status check, page open, snapshot, interaction, and cleanup.
- Defines strict browser tab cleanup and resource management rules after each scraping task.
- Offers error-handling guidelines for anti-scraping measures and fallback strategies.
Metadata
Frequently Asked Questions
What is Web scraping skill using Chrome + WebMCP?
Web scraping using Chrome + WebMCP. Primary method for all web crawling tasks. It is an AI Agent Skill for Claude Code / OpenClaw, with 722 downloads so far.
How do I install Web scraping skill using Chrome + WebMCP?
Run "/install spider" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Web scraping skill using Chrome + WebMCP free?
Yes, Web scraping skill using Chrome + WebMCP is completely free, licensed under MIT-0. You can download, install and use it at no cost.
Which platforms does Web scraping skill using Chrome + WebMCP support?
Web scraping skill using Chrome + WebMCP is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created Web scraping skill using Chrome + WebMCP?
It is built and maintained by Alex Wei (@sweihub); the current version is v1.0.0.
More Skills