← 返回 Skills 市场
🔌

Browse website - Crawls sites automatically and mounts pages as markdown files you can grep, diff, cat, and explore with standard Unix commands — over SSH or HTTP

作者 Bigmind · GitHub ↗ · v1.0.0 · MIT-0
cross-platform ⚠ suspicious
82
总下载
1
收藏
0
当前安装
1
版本数
在 OpenClaw 中安装
/install browse-website
功能描述
Turn any website into a filesystem. Crawls sites automatically and mounts pages as markdown files you can grep, diff, cat, and explore with standard Unix com...
使用说明 (SKILL.md)

Browse Website

Use OpenObj to access any website's content. Pages are automatically crawled, converted to markdown, and mounted as a virtual filesystem you can explore with standard Unix commands.

Network Access

All commands in this skill require network access to openobj.com.

Use required_permissions: ["full_network"] for all SSH and curl commands (they need to reach openobj.com).

How to Use

Preferred: SSH exec mode (works in terminals with network access):

# required_permissions: ["full_network"]
ssh {domain}@openobj.com "{command}"

Fallback: HTTP API via curl (works in sandboxed environments):

# required_permissions: ["full_network"]
curl -s -X POST https://openobj.com/exec \
  -H 'Content-Type: application/json' \
  -d '{"site": "{domain}", "command": "{command}"}'

Important: If SSH fails due to sandbox restrictions, fall back to the curl HTTP API. Both methods return the same results.

Available Commands

Command Description
find /site -type f List all indexed pages
cat {path} Read a page's markdown content
grep -rl '{term}' /site Find pages containing a term
grep -r '{term}' /site Search with matching lines
ls {path} List files in a directory
head -n 20 {path} Read first N lines
wc -l {path} Count lines in a file
git log --oneline View crawl history
git diff HEAD~1 See what changed in last crawl
git show {hash} View a specific crawl's changes
openobj rediscover Force a fresh re-crawl

Examples

Via SSH

# required_permissions: ["full_network"]
ssh [email protected] "find /site -type f"
ssh [email protected] "grep -rl 'webhook' /site"
ssh [email protected] "cat /site/docs/webhooks.md"

# Change tracking
ssh [email protected] "cd /site && git log --oneline"
ssh [email protected] "cd /site && git diff HEAD~1"

# Force re-crawl and see what changed
ssh [email protected] "openobj rediscover && cd /site && git diff HEAD~1"

Via HTTP API (curl)

# required_permissions: ["full_network"]
# List all pages
curl -s -X POST https://openobj.com/exec \
  -H 'Content-Type: application/json' \
  -d '{"site": "docs.stripe.com", "command": "find /site -type f"}'

# Search for a term
curl -s -X POST https://openobj.com/exec \
  -H 'Content-Type: application/json' \
  -d '{"site": "docs.stripe.com", "command": "grep -rl webhook /site"}'

# Read a page
curl -s -X POST https://openobj.com/exec \
  -H 'Content-Type: application/json' \
  -d '{"site": "docs.stripe.com", "command": "cat /site/docs/webhooks.md"}'

Workflow

  1. Discover — Run find /site -type f to see all available pages
  2. Search — Use grep -rl '{keyword}' /site to find relevant pages
  3. Read — Use cat {path} to read the full content of a page
  4. Refine — Use grep -r '{term}' {path} to search within specific files
  5. Track changes — Use git log and git diff to see what changed across crawls
  6. Re-crawl — Use openobj rediscover to force a fresh crawl and update pages

Behavior

  • First access to a domain triggers an automatic crawl (may take 10-30 seconds)
  • Subsequent accesses use the cached version (refreshed every 24 hours)
  • Use openobj rediscover to force a fresh crawl before the 24h window
  • Pages are converted from HTML to markdown automatically
  • Up to 200 pages per site are indexed
  • The virtual filesystem mirrors the site's URL structure
  • Each crawl is tracked as a git commit for change diffing

Credits

  • Crawling a new site or running openobj rediscover costs 1 credit per page
  • Reading cached content (cat, grep, find, ls, git) is always free
  • Free accounts get 100 one-time credits
  • If you get a credit limit error, do not retry — inform the user:
    • To check credits: ssh {any-domain}@openobj.com "openobj credits"
    • To upgrade: tell the user to run ssh [email protected] in their terminal
  • Prefer reading cached sites over re-crawling to conserve credits

Response Format

The HTTP API returns JSON:

{
  "stdout": "...",
  "stderr": "...",
  "exitCode": 0
}

Use the stdout field for the command output. A non-zero exitCode indicates an error.

安全使用建议
This skill simply instructs the agent to send your requested domain name and any command text to a third party (openobj.com) over SSH or HTTPS. Before installing or using it, consider: (1) Do you trust openobj.com to receive raw commands and site names? Anything the agent places into {command} or {domain} (including parts of your prompt or local context) can be transmitted to that host. (2) Do not use it with internal/private domains or include secrets, API keys, or file contents in commands — they could be exfiltrated. (3) The SKILL.md requests 'full_network' access but the registry metadata does not declare this — ensure your agent's policy requires explicit user consent for network access. (4) Crawling triggers credit costs per page; follow the doc's advice to prefer cached reads to avoid unexpected charges. If you need stronger safety: request the skill's source, run it in an isolated environment, or prefer a skill that performs crawling locally or on a trusted, auditable infrastructure.
功能分析
Type: OpenClaw Skill Name: browse-website Version: 1.0.0 The skill 'browse-website' (SKILL.md) allows an agent to crawl and explore websites by proxying commands through a third-party service at openobj.com via SSH or HTTPS. While the behavior matches the stated goal of providing a virtual filesystem for web content, the use of SSH to a remote host and the requirement for 'full_network' permissions are high-risk capabilities. Additionally, the instructions include a directive for the agent to guide users toward an external SSH-based 'upgrade' path (ssh [email protected]), which could be leveraged for social engineering or credential harvesting.
能力评估
Purpose & Capability
The skill's described purpose (turn a website into a filesystem) matches the runtime approach: it delegates crawling/mounting to openobj.com and exposes filesystem-like commands. However, the SKILL.md relies entirely on a remote service rather than providing local mounting code, which may be surprising to users who expect a local implementation. The remote dependency is reasonable for the described feature but should be explicit in registry metadata.
Instruction Scope
The instructions tell the agent to run ssh {domain}@openobj.com "{command}" or POST JSON containing the site and command to https://openobj.com/exec. That means any substituted {command} or {domain} (including data or context the agent inserts) will be transmitted to the third party. This creates a realistic risk of exfiltrating sensitive input, internal hostnames, or secrets. The doc also instructs falling back to the HTTP API if SSH is blocked, again sending plaintext JSON to a remote endpoint. The skill does not limit or sanitize what the agent may include in commands, and it references a required network permission inside SKILL.md that is not expressed in the registry metadata.
Install Mechanism
No install step or code is provided; the skill is instruction-only so nothing is written to disk by an install procedure. This is low technical risk but increases reliance on the remote service described in the instructions.
Credentials
The registry declares no environment variables or credentials, which is consistent with an instruction-only skill. However, the SKILL.md repeatedly requires 'full_network' access to openobj.com; that required permission is only present in the instructions (comments) and not in the registry metadata — an inconsistency. Also, although no env vars are requested, the runtime pattern (sending arbitrary commands/site names) can still leak secrets if the agent includes them in requests.
Persistence & Privilege
The skill does not request always:true, does not include install hooks or config file changes, and is user-invocable. It does not request permanent platform presence or elevated privileges in the manifest.
如何使用
  1. 确保已安装 OpenClaw(本地或 Docker 部署)
  2. 在对话框中输入安装命令:/install browse-website
  3. 安装完成后,直接呼叫该 Skill 的名称或使用 /browse-website 触发
  4. 根据 Skill 的参数说明提供必要输入,即可获得结构化输出
版本历史
v1.0.0
- Initial release of the "browse-website" skill. - Access any website as a virtual filesystem via OpenObj, with pages automatically crawled and mounted as markdown. - Supports standard Unix commands (grep, cat, diff, git) over SSH or HTTP API for exploring, searching, and tracking website content. - Provides methods for both SSH (preferred) and HTTP (curl) access. - Includes credit system: crawling costs 1 credit per page, reading cached content is free; free accounts get 100 credits. - Up to 200 pages per site are indexed, with automatic caching and change tracking via git commits.
元数据
Slug browse-website
版本 1.0.0
许可证 MIT-0
累计安装 0
当前安装数 0
历史版本数 1
常见问题

Browse website - Crawls sites automatically and mounts pages as markdown files you can grep, diff, cat, and explore with standard Unix commands — over SSH or HTTP 是什么?

Turn any website into a filesystem. Crawls sites automatically and mounts pages as markdown files you can grep, diff, cat, and explore with standard Unix com... 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件,目前累计下载 82 次。

如何安装 Browse website - Crawls sites automatically and mounts pages as markdown files you can grep, diff, cat, and explore with standard Unix commands — over SSH or HTTP?

在 OpenClaw 或 Claude Code 对话框中运行命令「/install browse-website」即可一键安装,无需额外配置。

Browse website - Crawls sites automatically and mounts pages as markdown files you can grep, diff, cat, and explore with standard Unix commands — over SSH or HTTP 是免费的吗?

是的,Browse website - Crawls sites automatically and mounts pages as markdown files you can grep, diff, cat, and explore with standard Unix commands — over SSH or HTTP 完全免费,采用 MIT-0 许可证,可自由下载、安装和使用。

Browse website - Crawls sites automatically and mounts pages as markdown files you can grep, diff, cat, and explore with standard Unix commands — over SSH or HTTP 支持哪些平台?

Browse website - Crawls sites automatically and mounts pages as markdown files you can grep, diff, cat, and explore with standard Unix commands — over SSH or HTTP 跨平台运行,可在任意部署了 OpenClaw / Claude Code 的环境中使用(cross-platform)。

谁开发了 Browse website - Crawls sites automatically and mounts pages as markdown files you can grep, diff, cat, and explore with standard Unix commands — over SSH or HTTP?

由 Bigmind(@bigmindai)开发并维护,当前版本 v1.0.0。

💬 留言讨论