← 返回 Skills 市场
crawl-for-ai
作者
AbelTennyson
· GitHub ↗
· v1.0.0
· MIT-0
79
总下载
0
收藏
0
当前安装
1
版本数
在 OpenClaw 中安装
/install abe-crawl-for-ai
功能描述
Web scraping via SkillBoss API Hub. Use for fetching full page content with JavaScript rendering. Handles complex pages with dynamic content.
使用说明 (SKILL.md)
Web Scraper via SkillBoss API Hub
SkillBoss API Hub scraping capability for full web page extraction with JavaScript rendering.
Usage
# Via script
node {baseDir}/scripts/crawl4ai.js "url"
node {baseDir}/scripts/crawl4ai.js "url" --json
Script options:
--json— Full JSON response
Output: Clean markdown from the page.
Configuration
Required environment variable:
SKILLBOSS_API_KEY— Your SkillBoss API Hub key
Features
- JavaScript rendering — Handles dynamic content
- Full content — HTML, markdown, links, media, tables
- Unified API — Powered by SkillBoss API Hub (
/v1/pilot)
API
Uses SkillBoss API Hub /v1/pilot with type: "scraping". Result is returned at data.result.
安全使用建议
This skill appears to do what it says: forward a URL to a remote scraping API and print the returned content. Before installing: (1) verify the service/domain (api.heybossai.com) and the publisher — there is no homepage/source listed; (2) confirm you trust SkillBoss/HeyBossAI to receive full page content and URLs (they will see any sensitive data on those pages); (3) use an API key with minimal scope and rotate or revoke it if you stop using the skill; (4) note metadata mismatches (registry shows no required env var; SKILL.md and script require SKILLBOSS_API_KEY, and version strings differ) — ask the publisher to clarify/provide source or a homepage; (5) test in a sandbox or with non‑sensitive URLs first. These issues make the package suspicious rather than clearly benign.
功能分析
Type: OpenClaw Skill
Name: abe-crawl-for-ai
Version: 1.0.0
The skill is a legitimate web scraping tool that interfaces with the SkillBoss API Hub (api.heybossai.com). The script 'scripts/crawl4ai.js' implements standard HTTPS requests to fetch web content and lacks any indicators of data exfiltration, malicious execution, or prompt injection.
能力标签
能力评估
Purpose & Capability
Name/description, SKILL.md, and the script all describe a web scraper that calls a remote SkillBoss API. Requiring the 'node' binary and an API key is consistent with that purpose. However registry metadata claimed no required env vars while SKILL.md and the script require SKILLBOSS_API_KEY; version numbers differ (registry 1.0.0 vs SKILL.md 1.0.1). These inconsistencies reduce trust in provenance but do not by themselves contradict the declared purpose.
Instruction Scope
Runtime instructions are narrowly scoped: run the provided Node script with a URL; the script reads only process.argv and process.env.SKILLBOSS_API_KEY, and posts the URL to api.heybossai.com/v1/pilot. There are no instructions to read arbitrary local files or other environment variables. The script returns page content or JSON — consistent with the stated functionality.
Install Mechanism
There is no install spec (instruction-only with a single included script). This is low risk: nothing is downloaded or executed beyond the provided script and the existing node binary.
Credentials
The script requires a single API key (SKILLBOSS_API_KEY), which is proportionate for a third‑party scraping service. However the registry metadata omitted this env var, creating an inconsistency. Also the skill sends URLs and scraped page content to an external domain (api.heybossai.com), which is expected behavior but has privacy implications—sensitive URLs or page contents will be transmitted to a third party.
Persistence & Privilege
The skill does not request elevated persistence (always:false) and does not modify other skills or system configuration. It can be invoked autonomously per platform defaults, which is normal; there is no additional privileged behavior in the files.
如何使用
- 确保已安装 OpenClaw（本地或 Docker 部署）
- 在对话框中输入安装命令：
/install abe-crawl-for-ai - 安装完成后，直接呼叫该 Skill 的名称或使用
/abe-crawl-for-ai触发 - 根据 Skill 的参数说明提供必要输入，即可获得结构化输出
版本历史
v1.0.0
- Added initial support for web page scraping via SkillBoss API Hub.
- Enables full page extraction with JavaScript rendering, suitable for dynamic and complex sites.
- Outputs clean markdown, including links, media, and tables.
- Requires SKILLBOSS_API_KEY environment variable.
- Provides script for command-line usage with JSON option.
元数据
常见问题
crawl-for-ai 是什么？
Web scraping via SkillBoss API Hub. Use for fetching full page content with JavaScript rendering. Handles complex pages with dynamic content. 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件，目前累计下载 79 次。
如何安装 crawl-for-ai？
在 OpenClaw 或 Claude Code 对话框中运行命令「/install abe-crawl-for-ai」即可一键安装，无需额外配置。
crawl-for-ai 是免费的吗？
是的，crawl-for-ai 完全免费，采用 MIT-0 许可证，可自由下载、安装和使用。
crawl-for-ai 支持哪些平台？
crawl-for-ai 跨平台运行，可在任意部署了 OpenClaw / Claude Code 的环境中使用（cross-platform）。
谁开发了 crawl-for-ai？
由 AbelTennyson（@abeltennyson）开发并维护，当前版本 v1.0.0。
推荐 Skills