← 返回 Skills 市场
Scrapling Fetch Basic
作者
shuxiangfanclaw
· GitHub ↗
· v1.0.0
· MIT-0
126
总下载
0
收藏
0
当前安装
1
版本数
在 OpenClaw 中安装
/install scrapling-fetch-basic
功能描述
基础网页抓取工具,支持绕过反爬系统、自动定位正文区域、HTML 转 Markdown。适合抓取博客、新闻、公告等静态页面。
安全使用建议
This skill appears internally consistent, but take these precautions before using it:
- Source verification: the package has no homepage and an unknown owner; inspect the scrapling dependency source (PyPI/GitHub) before installing and prefer installing in an isolated environment (virtualenv/container).
- Install notes: playwright will usually download browser binaries when first used (run 'playwright install' or follow its docs). That will add sizeable executables to the host; be prepared for that.
- SSRF / network risk: the script fetches arbitrary URLs. If you run it on a server that can access internal resources, an attacker-supplied URL could cause server-side requests to internal endpoints. Only run with trusted URLs or in a network-isolated environment.
- Legal/ethical: stealth mode and Cloudflare bypass are intended to evade anti-bot protections — ensure you have the right to scrape targets and comply with terms of service and laws.
- Dependency hygiene: install dependencies from official registries or pinned releases, review the 'scrapling' package code because the skill relies on it for network access and stealth behavior.
- Runtime safety: run first with --debug and limited targets; consider timeouts/rate limits to avoid unintended heavy load.
If you want higher assurance, ask the author for a homepage or source repository and a release provenance (e.g., GitHub repo and PyPI package/version).
功能分析
Type: OpenClaw Skill
Name: scrapling-fetch-basic
Version: 1.0.0
The skill is a legitimate web scraping tool designed to extract content from URLs and convert it to Markdown. It uses the 'scrapling' and 'html2text' libraries to provide basic and stealthy (browser-based) fetching modes as described in scripts/scrapling_fetch.py and SKILL.md, with no evidence of data exfiltration, malicious execution, or prompt injection.
能力评估
Purpose & Capability
Name/description (web scraping, Cloudflare/stealth, HTML→Markdown) align with the provided script and declared deps (scrapling, html2text, playwright). No unrelated env vars, binaries, or config paths are required.
Instruction Scope
SKILL.md describes running the included Python script; the script only fetches the target URL, extracts content with a set of selectors, converts to Markdown, and prints output or JSON. It does not attempt to read local files, other env vars, or exfiltrate results to external endpoints.
Install Mechanism
There is no install spec (instruction-only) and a single Python script is included. Dependencies are listed but not installed automatically; the user environment must install scrapling, html2text, and playwright. Playwright typically requires downloading browser binaries (user should be aware).
Credentials
No credentials, secret environment variables, or config paths are requested. Required libraries are proportional to the functionality (HTML parsing and optional browser automation).
Persistence & Privilege
Skill does not request persistent always:true, does not modify other skills or system configs, and is user-invocable only. The script is executed on demand and does not persist credentials or install itself.
如何使用
- 确保已安装 OpenClaw(本地或 Docker 部署)
- 在对话框中输入安装命令:
/install scrapling-fetch-basic - 安装完成后,直接呼叫该 Skill 的名称或使用
/scrapling-fetch-basic触发 - 根据 Skill 的参数说明提供必要输入,即可获得结构化输出
版本历史
v1.0.0
scrapling-fetch-basic 1.0.0 — 首发版
- 发布基础版网页抓取工具,支持静态页面内容提取与反爬绕过
- 自动定位正文区域,支持 11 种常用选择器
- 抓取结果可自动转换为 Markdown 格式
- 提供 basic 和 stealth 两种模式,满足常规与反爬页面需求
- 支持字符数自定义、JSON 输出等常用功能
元数据
常见问题
Scrapling Fetch Basic 是什么?
基础网页抓取工具,支持绕过反爬系统、自动定位正文区域、HTML 转 Markdown。适合抓取博客、新闻、公告等静态页面。 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件,目前累计下载 126 次。
如何安装 Scrapling Fetch Basic?
在 OpenClaw 或 Claude Code 对话框中运行命令「/install scrapling-fetch-basic」即可一键安装,无需额外配置。
Scrapling Fetch Basic 是免费的吗?
是的,Scrapling Fetch Basic 完全免费,采用 MIT-0 许可证,可自由下载、安装和使用。
Scrapling Fetch Basic 支持哪些平台?
Scrapling Fetch Basic 跨平台运行,可在任意部署了 OpenClaw / Claude Code 的环境中使用(cross-platform)。
谁开发了 Scrapling Fetch Basic?
由 shuxiangfanclaw(@shuxiangfanclaw)开发并维护,当前版本 v1.0.0。
推荐 Skills