← 返回 Skills 市场
Novel Scraper SPA
作者
yuzhihui886
· GitHub ↗
· v1.0.0
· MIT-0
95
总下载
0
收藏
0
当前安装
1
版本数
在 OpenClaw 中安装
/install novel-scraper-spa
功能描述
支持 JavaScript 加载的小说抓取工具,使用 Playwright 渲染 SPA 网站。自动检测网站类型,静态网站使用 curl,SPA 网站使用浏览器渲染。
安全使用建议
Before installing or running this skill:
- Expect to install Python dependencies manually: at minimum 'playwright', 'requests', and 'beautifulsoup4'. Also run 'playwright install' (or equivalent) to download browser engines — the skill does not declare or perform this.
- Because Playwright downloads browser binaries, running the skill will cause additional network downloads and write large files to disk; consider running in an isolated environment or virtualenv.
- The SKILL.md contains leftover template/TODO text and no dependency declarations — treat this as low-quality packaging rather than proof of malicious intent, but exercise caution.
- The scripts only fetch the target URL(s) and save scraped text locally (~/.openclaw/workspace/novels/). They do not exfiltrate data to other endpoints, but the tool will fetch arbitrary URLs you provide — avoid pointing it at internal/private endpoints or URLs requiring secrets unless you understand the risks.
- If you plan to use it, inspect and run the code in a sandboxed environment first, verify dependencies and that browser downloads are acceptable, and consider adding a requirements.txt and explicit install instructions (and lock Playwright/browser behavior) before using in production.
功能分析
Type: OpenClaw Skill
Name: novel-scraper-spa
Version: 1.0.0
The skill is a functional web scraping tool designed to handle both static and Single Page Application (SPA) websites using Playwright and BeautifulSoup. The implementation in scripts/scraper.py and scripts/browser.py is well-structured, follows the stated purpose, and saves data only to a local workspace directory (~/.openclaw/workspace/novels/). No evidence of data exfiltration, malicious execution, or prompt injection was found.
能力评估
Purpose & Capability
The skill's stated purpose (scraping SPA and static novel sites) matches the included scripts: requests/BeautifulSoup for static pages and Playwright-based rendering for SPA. However, the skill does not declare required Python packages (playwright, requests, bs4) or the browser binaries Playwright needs. That omission is disproportionate to the task and may surprise users at runtime.
Instruction Scope
SKILL.md instructs running the provided CLI (python3 scripts/scraper.py ...) and describes parameters and output location (~/.openclaw/workspace/novels/). The instructions do not ask the agent to read unrelated files, credentials, or to transmit scraped data to external endpoints. The doc contains leftover template TODO text, indicating the author didn't finish editing the README.
Install Mechanism
There is no install spec. That reduces automated risk (nothing is auto-downloaded by the skill itself) but is a practical problem because the code requires external runtime dependencies (Playwright and its browser engines). Playwright typically requires a manual 'playwright install' (which downloads browser binaries) or package install; the skill provides no guidance or declared dependency list.
Credentials
The skill requests no environment variables, credentials, or config paths. That is proportionate to its stated purpose: it scrapes arbitrary URLs provided by the user and saves output locally. There are no signs of hidden credential access or exfiltration in the included files.
Persistence & Privilege
The skill does not request 'always: true' or elevated persistence. It is user-invocable and can run autonomously per platform defaults, which is expected. It does not modify other skills or system configuration beyond writing output to the user's ~/.openclaw workspace.
如何使用
- 确保已安装 OpenClaw(本地或 Docker 部署)
- 在对话框中输入安装命令:
/install novel-scraper-spa - 安装完成后,直接呼叫该 Skill 的名称或使用
/novel-scraper-spa触发 - 根据 Skill 的参数说明提供必要输入,即可获得结构化输出
版本历史
v1.0.0
初始版本
元数据
常见问题
Novel Scraper SPA 是什么?
支持 JavaScript 加载的小说抓取工具,使用 Playwright 渲染 SPA 网站。自动检测网站类型,静态网站使用 curl,SPA 网站使用浏览器渲染。 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件,目前累计下载 95 次。
如何安装 Novel Scraper SPA?
在 OpenClaw 或 Claude Code 对话框中运行命令「/install novel-scraper-spa」即可一键安装,无需额外配置。
Novel Scraper SPA 是免费的吗?
是的,Novel Scraper SPA 完全免费,采用 MIT-0 许可证,可自由下载、安装和使用。
Novel Scraper SPA 支持哪些平台?
Novel Scraper SPA 跨平台运行,可在任意部署了 OpenClaw / Claude Code 的环境中使用(cross-platform)。
谁开发了 Novel Scraper SPA?
由 yuzhihui886(@yuzhihui886)开发并维护,当前版本 v1.0.0。
推荐 Skills