← 返回 Skills 市场

Aliyun Platform Docs Benchmark

Name: Aliyun Platform Docs Benchmark
Author: cinience

作者 cinience · GitHub ↗ · v1.0.0 · MIT-0

cross-platform ⚠ suspicious

总下载

当前安装

版本数

在 OpenClaw 中安装

/install aliyun-platform-docs-benchmark

功能描述

Use when benchmarking similar product documentation and API documentation across Alibaba Cloud, AWS, Azure, GCP, Tencent Cloud, Volcano Engine, and Huawei Cl...

使用说明 (SKILL.md)

Multi-Cloud Product Docs/API Benchmark

Use this skill when the user wants cross-cloud documentation/API comparison for similar products.

Supported clouds

Alibaba Cloud
AWS
Azure
GCP
Tencent Cloud
Volcano Engine
Huawei Cloud

Data source policy

L0 (highest): user-pinned official links via --\x3Cprovider>-links
L1: machine-readable official metadata/source
- GCP: Discovery API
- AWS: API Models repository
- Azure: REST API Specs repository
L2: official-domain constrained web discovery fallback
L3: insufficient discovery (low confidence)

Workflow

Run the benchmark script:

python skills/platform/docs/aliyun-platform-docs-benchmark/scripts/benchmark_multicloud_docs_api.py --product "\x3Cproduct keyword>"

Example:

python skills/platform/docs/aliyun-platform-docs-benchmark/scripts/benchmark_multicloud_docs_api.py --product "serverless"

LLM platform benchmark example (Bailian/Bedrock/Azure OpenAI/Vertex AI/Hunyuan/Ark/Pangu):

python skills/platform/docs/aliyun-platform-docs-benchmark/scripts/benchmark_multicloud_docs_api.py --product "Bailian" --preset "llm-platform"

If --preset is omitted, script attempts to auto-match preset based on keyword.

Scoring weights can be switched by profile (see references/scoring.json):

python skills/platform/docs/aliyun-platform-docs-benchmark/scripts/benchmark_multicloud_docs_api.py --product "Bailian" --preset "llm-platform" --scoring-profile "llm-platform"

Optional: pin authoritative links

Auto-discovery may miss pages. For stricter comparison, pass official links manually:

python skills/platform/docs/aliyun-platform-docs-benchmark/scripts/benchmark_multicloud_docs_api.py \
  --product "object storage" \
  --aws-links "https://docs.aws.amazon.com/AmazonS3/latest/userguide/Welcome.html" \
  --azure-links "https://learn.microsoft.com/azure/storage/blobs/"

Available manual flags:

--alicloud-links
--aws-links
--azure-links
--gcp-links
--tencent-links
--volcengine-links
--huawei-links

Each flag accepts comma-separated URLs.

Output policy

All artifacts must be written under:

output/aliyun-platform-docs-benchmark/

Per run:

benchmark_evidence.json
benchmark_report.md

Reporting guidance

When answering the user:

Show score ranking across all providers.
Highlight top gaps (P0/P1/P2) and concrete fix actions.
If discovery confidence is low, ask user to provide pinned links and rerun.

Validation

mkdir -p output/aliyun-platform-docs-benchmark
for f in skills/platform/docs/aliyun-platform-docs-benchmark/scripts/*.py; do
  python3 -m py_compile "$f"
done
echo "py_compile_ok" > output/aliyun-platform-docs-benchmark/validate.txt

Pass criteria: command exits 0 and output/aliyun-platform-docs-benchmark/validate.txt is generated.

Output And Evidence

Save artifacts, command outputs, and API response summaries under output/aliyun-platform-docs-benchmark/.
Include key parameters (region/resource id/time range) in evidence files for reproducibility.

Prerequisites

Configure least-privilege Alibaba Cloud credentials before execution.
Prefer environment variables: ALICLOUD_ACCESS_KEY_ID, ALICLOUD_ACCESS_KEY_SECRET, optional ALICLOUD_REGION_ID.
If region is unclear, ask the user before running mutating operations.

References

Rubric: references/review-rubric.md

安全使用建议

This skill appears to implement a reasonable multi-cloud docs benchmarking tool, but there are two things to check before running it: (1) the SKILL.md asks you to provide Alibaba Cloud credentials (ALICLOUD_ACCESS_KEY_ID / ALICLOUD_ACCESS_KEY_SECRET) and optional region, yet the skill manifest does not declare any required environment variables—ask the author to explicitly declare these env vars in the skill metadata and explain exactly what API calls require them. (2) Inspect the Python script for any operations that modify cloud resources or send data to external endpoints (it performs web/API discovery and writes an output directory; confirm it does not call any mutating APIs or post sensitive evidence elsewhere). If you must run it, use isolated/least-privilege test credentials, avoid using production secrets, prefer providing pinned official links instead of credentials when possible, and run the script in an isolated environment so you can review generated output before sharing it.

功能分析

Type: OpenClaw Skill Name: aliyun-platform-docs-benchmark Version: 1.0.0 The skill bundle is classified as suspicious because SKILL.md instructs the agent and user to configure sensitive Alibaba Cloud credentials (ALICLOUD_ACCESS_KEY_ID and ALICLOUD_ACCESS_KEY_SECRET) as a prerequisite, despite the provided script (benchmark_multicloud_docs_api.py) only performing read-only operations on public documentation and metadata APIs. The script itself appears functional, using urllib to query DuckDuckGo, GitHub, and public Alibaba Cloud endpoints, but it never utilizes the requested credentials. This discrepancy suggests either a poorly constructed template or a potential credential-fishing attempt by encouraging the placement of secrets into the environment where they are not required for the stated task.

能力评估

ℹ Purpose & Capability

Name/description (multi-cloud docs/API benchmark) align with included code and resources (discovery, scoring, presets). Requesting Alibaba Cloud metadata as an optional enrichment is plausible for an 'Aliyun' branded benchmark, but the skill metadata declares no required env vars while the runtime instructions explicitly request ALICLOUD_* credentials — an inconsistency.

⚠ Instruction Scope

SKILL.md instructs the agent to run a local Python script that performs web discovery and API calls and to 'configure least-privilege Alibaba Cloud credentials' and include region/resource id/time range in evidence. It also warns to ask the user before running mutating operations, which implies possible non-read-only interactions. The instructions therefore reach beyond pure passive scraping and could touch cloud APIs or collect sensitive parameters; those behaviors are not fully declared or scoped in the manifest.

✓ Install Mechanism

No install spec; skill is instruction + Python script relying on standard library (urllib, json, re). No third-party packages or external binary downloads were declared, which is proportional and lower-risk.

⚠ Credentials

The manifest lists no required environment variables, but SKILL.md asks for ALICLOUD_ACCESS_KEY_ID / ALICLOUD_ACCESS_KEY_SECRET (and optional region). Requesting cloud credentials (even 'least-privilege') is sensitive and should be declared in requires.env; currently the credential request is undocumented in the metadata and therefore disproportionate/untracked.

✓ Persistence & Privilege

always:false and no install hooks were declared. The skill does write output artifacts to a local output/ directory per its instructions, which is expected for a benchmarking script. It does not request permanent platform-level privileges in the manifest.

如何使用

确保已安装 OpenClaw（本地或 Docker 部署）
在对话框中输入安装命令：/install aliyun-platform-docs-benchmark
安装完成后，直接呼叫该 Skill 的名称或使用 /aliyun-platform-docs-benchmark 触发
根据 Skill 的参数说明提供必要输入，即可获得结构化输出

版本历史

v1.0.0

Initial release of aliyun-platform-docs-benchmark. - Enables benchmarking of product and API documentation across major cloud providers (Alibaba Cloud, AWS, Azure, GCP, Tencent Cloud, Volcano Engine, Huawei Cloud). - Automatically discovers, scores, and compares documentation links given a product keyword. - Outputs detailed, prioritized improvement recommendations and scoring breakdowns. - Supports manual pinning of authoritative links to ensure strict comparison. - Artifacts and reports are saved under a dedicated output directory for traceability and reproducibility. - Includes validation steps and configuration guidance for cloud credentials.

元数据

Slug aliyun-platform-docs-benchmark

版本 1.0.0

许可证 MIT-0

累计安装 0

当前安装数 0

历史版本数 1

常见问题