← 返回 Skills 市场
512
总下载
0
收藏
1
当前安装
2
版本数
在 OpenClaw 中安装
/install web-scraper-pro
功能描述
Intelligent web scraper that fetches any URL and returns clean Markdown content. Triggers on requests like "帮我抓取网页", "获取这个网页内容", "fetch this URL", "scrape th...
安全使用建议
This skill will send any requested URL (and the resulting page content) to several external conversion services and will call a SkillPay billing API before performing the fetch. Notable issues: (1) the code includes a hard-coded SkillPay API key in the repository — this key authorizes billing calls and should not be embedded in a published skill; (2) fetched content will be transmitted to third parties (markdown.new, defuddle.md, r.jina.ai, Scrapling), so do not use this on sensitive or internal URLs; (3) the skill forces payment verification and may charge or direct users to top-up links that route funds to the key-owner. Before installing, ask the publisher to: remove any embedded API keys and require callers to supply their own billing credentials, document what data is sent to each third party, and provide a privacy/terms link. If you must use it, test in a sandbox, avoid sensitive URLs, and insist on using your own billing credentials (or disable the monetization flow).
功能分析
Type: OpenClaw Skill
Name: web-scraper-pro
Version: 1.1.0
The skill bundle implements a mandatory micro-payment gatekeeper using a third-party service (skillpay.me) and hardcoded API credentials in SKILL.md and payment.py. It uses aggressive prompt instructions to force the AI agent to perform financial transactions (charging 0.001 USDT) before providing the advertised scraping functionality. While no direct system compromise or data theft was observed, the hardcoded 'Secret Key' (sk_d6d26f29...) and the enforcement of a proprietary payment layer are highly irregular for a skill bundle and could be used for unauthorized monetization or user tracking.
能力评估
Purpose & Capability
The name/description (web scraper → convert URL to Markdown) matches the instructions and code for fetching and converting web pages. However, the SKILL.md and payment.py embed a monetization flow (SkillPay) with a hard-coded API key and SKILL_ID; a monetized scraper can be legitimate, but a shipping skill that contains someone else's billing API key rather than asking the deployer to configure their own credentials is unexpected and questionable.
Instruction Scope
Runtime instructions require executing a payment verification step (network call to skillpay.me) before any fetch. The fetch flow sends the target URL (and effectively the page content) to third-party services (markdown.new, defuddle.md, r.jina.ai, and an included Scrapling library). That means user-provided URLs/content will be transmitted to multiple external endpoints — a clear privacy/data-exfiltration risk for sensitive or internal URLs.
Install Mechanism
No installation spec; skill is instruction-only with an included payment.py file. No external archive downloads or unusual install steps were specified. Risk from install mechanism is low.
Credentials
The bundle does not declare required env vars but both SKILL.md and payment.py include a hard-coded BILLING_API_KEY value (sk_...) and a SKILL_ID. Hard-coding a secret API key is a red flag: it grants the skill author (or whoever controls that key) the ability to perform billing operations on that billing endpoint on behalf of users. The only environment variable referenced is SKILLPAY_USER_ID (used as user identifier), which is reasonable, but the embedded key makes the credential model asymmetric and surprising.
Persistence & Privilege
always is false and nothing in the files requests persistent platform-wide privileges or modifies other skills. The payment decorator/context manager enforces payment before function execution but does not change agent configuration beyond its own behavior.
如何使用
- 确保已安装 OpenClaw(本地或 Docker 部署)
- 在对话框中输入安装命令:
/install web-scraper-pro - 安装完成后,直接呼叫该 Skill 的名称或使用
/web-scraper-pro触发 - 根据 Skill 的参数说明提供必要输入,即可获得结构化输出
版本历史
v1.1.0
Fix SkillPay API integration: correct endpoint, auth header, skill_id, and response handling
v1.0.0
Initial release with multi-layer fetch strategy and SkillPay payment integration
元数据
常见问题
Web Scraper Pro 是什么?
Intelligent web scraper that fetches any URL and returns clean Markdown content. Triggers on requests like "帮我抓取网页", "获取这个网页内容", "fetch this URL", "scrape th... 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件,目前累计下载 512 次。
如何安装 Web Scraper Pro?
在 OpenClaw 或 Claude Code 对话框中运行命令「/install web-scraper-pro」即可一键安装,无需额外配置。
Web Scraper Pro 是免费的吗?
是的,Web Scraper Pro 完全免费(开源免费),可自由下载、安装和使用。
Web Scraper Pro 支持哪些平台?
Web Scraper Pro 跨平台运行,可在任意部署了 OpenClaw / Claude Code 的环境中使用(cross-platform)。
谁开发了 Web Scraper Pro?
由 LiuSir(@codehourra)开发并维护,当前版本 v1.1.0。
推荐 Skills