← 返回 Skills 市场
Novel Scraper Pro
作者
yuzhihui886
· GitHub ↗
· v2.0.3
· MIT-0
115
总下载
0
收藏
0
当前安装
4
版本数
在 OpenClaw 中安装
/install novel-scraper-pro
功能描述
智能小说抓取工具 V6,支持自动翻页、分页补全、章节号自动解析、内存监控、中断续抓。 使用 curl+BeautifulSoup 抓取笔趣阁等小说网站,输出格式化 TXT 文件。 默认每 10 章合并为一个文档,避免文件零散分布。 自动检测分页并补全,智能跳过非小说内容(作者感言、抽奖预告等)。 内存监控和中断续...
安全使用建议
This skill appears to be what it says: a local novel scraper that uses curl/BeautifulSoup and optionally an 'openclaw browser' CLI for SPA sites. Before installing, consider: 1) it will perform network requests to arbitrary URLs you pass (respect site terms of service); 2) it invokes subprocesses (curl and openclaw browser) — ensure you trust those CLIs and the environment where it will run; 3) it reads /proc/meminfo and writes files under ~/.openclaw/workspace and /tmp, including a progress.json you may delete to reset state; 4) there are small inconsistencies (some filenames/paths and version strings differ across files, e.g., fetch_catalog writes to a 'novel-scraper' path while other scripts use 'novel-scraper-pro') — these are not security-critical but may cause confusion or require you to adjust paths; 5) run the skill in an isolated environment or sandbox if you plan to scrape untrusted websites. If you need higher assurance, inspect or run the included scripts locally in a safe environment and verify the behavior of the 'openclaw browser' CLI before enabling SPA mode.
功能分析
Type: OpenClaw Skill
Name: novel-scraper-pro
Version: 2.0.3
The novel-scraper-pro skill bundle is a functional utility designed to scrape web novels from specific sites like Biquge using curl and BeautifulSoup. The code in scraper.py, fetch_catalog.py, and other scripts is well-structured and includes security measures such as URL scheme validation and a blacklist of shell-injection characters (e.g., ';', '|', '&') before executing subprocess commands. The tool's behavior, including file I/O in the workspace directory and memory monitoring via /proc/meminfo, is entirely consistent with its stated purpose, and there is no evidence of data exfiltration, prompt injection, or malicious intent.
能力评估
Purpose & Capability
Name/description match the code and SKILL.md: all scripts implement scraping, catalog fetching, URL extraction and merging. Required capabilities (curl, BeautifulSoup or bs4) are consistent with the stated purpose. No unrelated credentials or tools are requested.
Instruction Scope
Runtime instructions tell the agent to run the included Python scripts which read/write files under ~/.openclaw/workspace and /tmp, call curl and (optionally) an 'openclaw browser' CLI, and read /proc/meminfo for memory checks. These actions are within scope for a scraper, but the skill will perform network requests and create/modify local files (including progress/state).
Install Mechanism
No install spec that downloads code at install time; dependencies are standard Python packages (beautifulsoup4/bs4) listed in requirements.txt. The project runs subprocess curl/CLI commands rather than installing arbitrary binaries from remote URLs.
Credentials
The skill requests no environment variables or external credentials. It reads local system info (/proc/meminfo) and writes state/cache under the user's home (~/.openclaw and /tmp) which is expected for progress caching and output files.
Persistence & Privilege
always is false and the skill does not request platform-level persistence. It writes its own state/progress files in its workspace but does not modify other skills or global agent settings.
如何使用
- 确保已安装 OpenClaw(本地或 Docker 部署)
- 在对话框中输入安装命令:
/install novel-scraper-pro - 安装完成后,直接呼叫该 Skill 的名称或使用
/novel-scraper-pro触发 - 根据 Skill 的参数说明提供必要输入,即可获得结构化输出
版本历史
v2.0.3
修复缓存命中导致分页不完整:缓存<50 段时重新抓取
v2.0.2
修复分页补全超时问题
v2.0.1
修复:进度保存逻辑、check_memory 返回值
v2.0.0
V6 增强版:内存监控 + 中断续抓(默认开启)+ SPA 支持
元数据
常见问题
Novel Scraper Pro 是什么?
智能小说抓取工具 V6,支持自动翻页、分页补全、章节号自动解析、内存监控、中断续抓。 使用 curl+BeautifulSoup 抓取笔趣阁等小说网站,输出格式化 TXT 文件。 默认每 10 章合并为一个文档,避免文件零散分布。 自动检测分页并补全,智能跳过非小说内容(作者感言、抽奖预告等)。 内存监控和中断续... 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件,目前累计下载 115 次。
如何安装 Novel Scraper Pro?
在 OpenClaw 或 Claude Code 对话框中运行命令「/install novel-scraper-pro」即可一键安装,无需额外配置。
Novel Scraper Pro 是免费的吗?
是的,Novel Scraper Pro 完全免费,采用 MIT-0 许可证,可自由下载、安装和使用。
Novel Scraper Pro 支持哪些平台?
Novel Scraper Pro 跨平台运行,可在任意部署了 OpenClaw / Claude Code 的环境中使用(cross-platform)。
谁开发了 Novel Scraper Pro?
由 yuzhihui886(@yuzhihui886)开发并维护,当前版本 v2.0.3。
推荐 Skills