← 返回 Skills 市场
724
总下载
2
收藏
6
当前安装
6
版本数
在 OpenClaw 中安装
/install clean-content-fetch
功能描述
获取干净、可读的网页正文内容，适合现代网页、博客、新闻、公告和微信公众号文章抓取；支持网页正文提取、内容清洗、去噪、Markdown 输出，适用于普通 fetch 效果不佳、页面噪音较多或动态渲染干扰的场景。Clean content fetch for modern web pages, article ext...
使用说明 (SKILL.md)
Scrapling Web Fetch
当用户要获取网页内容、正文提取、把网页转成 markdown/text、抓取文章主体时，优先使用此技能。
默认流程
- 使用
python3 scripts/scrapling_fetch.py \x3Curl> \x3Cmax_chars> - 默认正文选择器优先级：
articlemain.post-content[class*="body"]
- 命中正文后，使用
html2text转 Markdown - 若都未命中，回退到
body - 最终按
max_chars截断输出
用法
python3 scripts/scrapling_fetch.py \x3Curl> 30000
依赖
常见依赖包括：
scraplinghtml2textcurl_cffiplaywrightbrowserforge
建议在隔离环境中安装依赖，再运行脚本。若宿主环境限制系统级 pip 安装，可使用项目级虚拟环境。
示例：
python3 -m venv .venv
. .venv/bin/activate
pip install scrapling html2text curl_cffi playwright browserforge
python -m playwright install chromium
python scripts/scrapling_fetch.py \x3Curl> 30000
输出约定
脚本默认输出 Markdown 正文内容。
如需结构化输出，可追加 --json。
如需调试提取命中了哪个 selector，可查看 stderr 输出。
附加资源
- 用法参考：
references/usage.md - 选择器策略：
references/selectors.md - 统一入口：
scripts/fetch-web-content
何时用这个技能
- 获取文章正文
- 抓博客/新闻/公告正文
- 将网页转成 Markdown 供后续总结
- 常规 fetch 效果差，希望提升现代网页抓取稳定性
- 抓小红书分享短链或笔记落地页正文
小红书抓取方法
对于 xhslink.com 短链或小红书笔记页，可直接运行：
python3 scripts/scrapling_fetch.py 'http://xhslink.com/o/9745hugimlD' 30000
说明：
- 脚本会先解析短链并抓取落地页正文
- 适合提取小红书笔记文案、标题和主体内容
- 若页面需要更复杂交互，再切到浏览器自动化
安全边界
- 仅用于抓取公开网页的正文内容与可读文本
- 不用于登录后页面、私有数据、受限资源或绕过权限控制
- 若目标页面需要账号登录、点击授权、滚动交互或复杂会话状态，应改用浏览器自动化并在明确授权下执行
何时不用
- 需要完整浏览器交互、点击、登录、翻页时：改用浏览器自动化
- 只是简单获取 API JSON：直接请求 API 更合适
安全使用建议
This skill's README-like instructions expect a scripts/ directory and a script named scripts/scrapling_fetch.py, but those scripts are not included in the package. Before installing or running anything: 1) Ask the publisher for the missing script files or an authoritative source (git repo or release) and verify their contents. 2) Never pip-install packages system-wide for unknown code — use an isolated virtual environment or container. 3) Inspect any fetched scripts for network calls, hidden endpoints, or code that exfiltrates data before running; Pay special attention to code that uses browser automation (Playwright) because it will load remote pages and may execute page JS. 4) If you must run this, do so in a sandbox (container/VM) and avoid supplying credentials. 5) If the runtime environment already provides the referenced scripts, review them the same way — the absence of included code is the primary incoherence and increases risk of pulling code from unverified locations.
功能分析
Type: OpenClaw Skill
Name: clean-content-fetch
Version: 1.0.5
The skill bundle describes a web scraping utility designed to extract clean, readable content from modern websites, including WeChat and Xiaohongshu, and convert it to Markdown. It utilizes standard scraping libraries such as Scrapling, Playwright, and html2text. No evidence of malicious intent, data exfiltration, or harmful prompt injections was found in the provided documentation (SKILL.md, references/usage.md) or metadata.
能力评估
Purpose & Capability
The name/description claim a content-extraction tool that runs a Python pipeline (scrapling + html2text + optional Playwright). That purpose would legitimately need the referenced scripts and possibly those dependencies. However, the package contains only reference docs and no scripts (e.g., scripts/scrapling_fetch.py is referenced in SKILL.md but not present). This mismatch means the skill as delivered cannot perform its stated function without fetching or relying on external code.
Instruction Scope
SKILL.md gives concrete runtime instructions (run python3 scripts/scrapling_fetch.py <url> <max_chars>, install packages, optionally use playwright) which are narrowly scoped to fetching and cleaning public webpages. Those instructions do not ask for unrelated system files or credentials. The problem is they direct execution of a script that is not included; if an agent attempted to follow them it would need to obtain or install code from elsewhere, which is not documented here and increases risk.
Install Mechanism
There is no install spec and no binaries packaged. That keeps the skill low-risk from an automatic-install perspective. The SKILL.md recommends pip installs and playwright browser installation — standard for this functionality — but these are manual recommendations, not an automated install step included in the package.
Credentials
The skill requests no environment variables, no credentials, and no config-path access. The declared dependencies (scrapling, html2text, curl_cffi, playwright, browserforge) align with web fetching and rendering. Nothing in the description asks for unrelated secrets or system access.
Persistence & Privilege
The skill is user-invocable, not always-on, and does not request to modify other skills or persist configuration. Autonomous invocation is allowed by default but is not combined with any other high-risk factor here.
如何使用
- 确保已安装 OpenClaw（本地或 Docker 部署）
- 在对话框中输入安装命令：
/install clean-content-fetch - 安装完成后，直接呼叫该 Skill 的名称或使用
/clean-content-fetch触发 - 根据 Skill 的参数说明提供必要输入，即可获得结构化输出
版本历史
v1.0.5
Republish full bundle after path cleanup
v1.0.4
Finalize portable docs and remove remaining absolute paths
v1.0.3
Remove absolute paths and clarify safety boundaries
v1.0.2
Rename local folder and add Xiaohongshu fetch guidance
v1.0.1
Refine description and trigger keywords for better auto-matching
v1.0.0
Initial publish
元数据
常见问题
Clean Content Fetch 是什么？
获取干净、可读的网页正文内容，适合现代网页、博客、新闻、公告和微信公众号文章抓取；支持网页正文提取、内容清洗、去噪、Markdown 输出，适用于普通 fetch 效果不佳、页面噪音较多或动态渲染干扰的场景。Clean content fetch for modern web pages, article ext... 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件，目前累计下载 724 次。
如何安装 Clean Content Fetch？
在 OpenClaw 或 Claude Code 对话框中运行命令「/install clean-content-fetch」即可一键安装，无需额外配置。
Clean Content Fetch 是免费的吗？
是的，Clean Content Fetch 完全免费，采用 MIT-0 许可证，可自由下载、安装和使用。
Clean Content Fetch 支持哪些平台？
Clean Content Fetch 跨平台运行，可在任意部署了 OpenClaw / Claude Code 的环境中使用（cross-platform）。
谁开发了 Clean Content Fetch？
由 晨冬（@jllyzzd）开发并维护，当前版本 v1.0.5。
推荐 Skills