← 返回 Skills 市场

Alicloud Platform Multicloud Docs Api Benchmark

Name: Alicloud Platform Multicloud Docs Api Benchmark
Author: cinience

作者 cinience · GitHub ↗ · v1.0.1 · MIT-0

cross-platform ⚠ suspicious

794

总下载

当前安装

版本数

在 OpenClaw 中安装

/install alicloud-platform-multicloud-docs-api-benchmark

功能描述

Benchmark similar product documentation and API documentation across Alibaba Cloud, AWS, Azure, GCP, Tencent Cloud, Volcano Engine, and Huawei Cloud. Given o...

使用说明 (SKILL.md)

Multi-Cloud Product Docs/API Benchmark

Use this skill when the user wants cross-cloud documentation/API comparison for similar products.

Supported clouds

Alibaba Cloud
AWS
Azure
GCP
Tencent Cloud
Volcano Engine
Huawei Cloud

Data source policy

L0 (highest): user-pinned official links via --\x3Cprovider>-links
L1: machine-readable official metadata/source
- GCP: Discovery API
- AWS: API Models repository
- Azure: REST API Specs repository
L2: official-domain constrained web discovery fallback
L3: insufficient discovery (low confidence)

Workflow

Run the benchmark script:

python skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/benchmark_multicloud_docs_api.py --product "\x3Cproduct keyword>"

Example:

python skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/benchmark_multicloud_docs_api.py --product "serverless"

LLM platform benchmark example (Bailian/Bedrock/Azure OpenAI/Vertex AI/Hunyuan/Ark/Pangu):

python skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/benchmark_multicloud_docs_api.py --product "Bailian" --preset "llm-platform"

If --preset is omitted, script attempts to auto-match preset based on keyword.

Scoring weights can be switched by profile (see references/scoring.json):

python skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/benchmark_multicloud_docs_api.py --product "Bailian" --preset "llm-platform" --scoring-profile "llm-platform"

Optional: pin authoritative links

Auto-discovery may miss pages. For stricter comparison, pass official links manually:

python skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/benchmark_multicloud_docs_api.py \
  --product "object storage" \
  --aws-links "https://docs.aws.amazon.com/AmazonS3/latest/userguide/Welcome.html" \
  --azure-links "https://learn.microsoft.com/azure/storage/blobs/"

Available manual flags:

--alicloud-links
--aws-links
--azure-links
--gcp-links
--tencent-links
--volcengine-links
--huawei-links

Each flag accepts comma-separated URLs.

Output policy

All artifacts must be written under:

output/alicloud-platform-multicloud-docs-api-benchmark/

Per run:

benchmark_evidence.json
benchmark_report.md

Reporting guidance

When answering the user:

Show score ranking across all providers.
Highlight top gaps (P0/P1/P2) and concrete fix actions.
If discovery confidence is low, ask user to provide pinned links and rerun.

Validation

mkdir -p output/alicloud-platform-multicloud-docs-api-benchmark
for f in skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/*.py; do
  python3 -m py_compile "$f"
done
echo "py_compile_ok" > output/alicloud-platform-multicloud-docs-api-benchmark/validate.txt

Pass criteria: command exits 0 and output/alicloud-platform-multicloud-docs-api-benchmark/validate.txt is generated.

Output And Evidence

Save artifacts, command outputs, and API response summaries under output/alicloud-platform-multicloud-docs-api-benchmark/.
Include key parameters (region/resource id/time range) in evidence files for reproducibility.

Prerequisites

Configure least-privilege Alibaba Cloud credentials before execution.
Prefer environment variables: ALICLOUD_ACCESS_KEY_ID, ALICLOUD_ACCESS_KEY_SECRET, optional ALICLOUD_REGION_ID.
If region is unclear, ask the user before running mutating operations.

References

Rubric: references/review-rubric.md

安全使用建议

This skill appears to implement the advertised cross-cloud docs benchmarking, but there are two things you should confirm before installing or running it: 1) Clarify credential needs: SKILL.md asks for Alibaba Cloud credentials (ALICLOUD_ACCESS_KEY_ID / ALICLOUD_ACCESS_KEY_SECRET) but the skill metadata does not declare any required env vars. Ask the author why keys are needed, what API calls will be made with them, and whether the script can run in a read-only mode without credentials. Do not supply production credentials until you understand the exact API calls. 2) Limit sensitive outputs: The instructions ask you to include region/resource IDs/time ranges in evidence files. Decide whether those identifiers are safe to write to disk and share. Run the script in an isolated environment (throwaway account or limited-privilege keys) and review output/ files before sharing. Other practical steps: - Inspect the full script for any code paths that perform mutating operations (create/delete) or send data to unexpected endpoints. If unsure, run the provided validation (py_compile step) first and then run discovery with pinned links and a harmless product keyword. - Request the maintainer update the package metadata to declare any required env vars (ALICLOUD_*) and explain exactly why they are needed. If the author confirms the script only uses credentials for non-mutating metadata fetches and updates the manifest accordingly, the skill is more coherent; until then treat it with caution.

功能分析

Type: OpenClaw Skill Name: alicloud-platform-multicloud-docs-api-benchmark Version: 1.0.1 The skill bundle is a legitimate benchmarking tool designed to compare product documentation across multiple cloud providers. The Python script (benchmark_multicloud_docs_api.py) discovers official documentation links using DuckDuckGo scraping, the GCP Discovery API, and GitHub code search, then analyzes the fetched content for quality indicators like 'quick start' or 'API reference' sections. While the SKILL.md mentions configuring Alibaba Cloud credentials, the provided code only interacts with public metadata endpoints and does not attempt to exfiltrate sensitive information, execute arbitrary commands, or establish persistence.

能力评估

⚠ Purpose & Capability

Name/description and included script match the advertised function (discover and score cloud provider docs). However SKILL.md explicitly asks users to 'Configure least-privilege Alibaba Cloud credentials' (ALICLOUD_ACCESS_KEY_ID/ALICLOUD_ACCESS_KEY_SECRET) even though the skill's registry metadata lists no required environment variables or primary credential. Requesting provider credentials (for Alibaba Cloud) is not obviously necessary for a read-only docs discovery task unless the script calls Alibaba APIs — the metadata and manifest should declare that credential requirement but do not.

⚠ Instruction Scope

Runtime instructions are concrete (how to run script, where outputs go) and primarily read-only (web discovery, GCP Discovery API, GitHub code search, DuckDuckGo). However the SKILL.md asks to include 'region/resource id/time range' in evidence files and warns about 'mutating operations' — that encourages collection of potentially sensitive resource identifiers. The instructions also tell users to provide cloud credentials, which broadens scope beyond simple web scraping. The script writes output artifacts to disk under an output/ path, which is expected.

✓ Install Mechanism

No install spec; the skill is instruction-only with a standalone Python script. This is the lowest install risk (nothing is downloaded or executed at install time). The script uses only Python stdlib networking (urllib), which is expected for a discovery/benchmark tool.

⚠ Credentials

SKILL.md requests ALICLOUD_ACCESS_KEY_ID, ALICLOUD_ACCESS_KEY_SECRET (and optional ALICLOUD_REGION_ID) but the manifest/registry shows no required environment variables or primary credential. Requiring cloud credentials for a documentation benchmark is plausible only if it fetches provider-specific API metadata that requires auth, but that intent is not clearly declared in metadata — this mismatch reduces transparency and could lead users to supply keys without an explicit need or justification.

✓ Persistence & Privilege

The skill is not marked always:true and does not request system-wide persistence. It can be invoked autonomously (platform default), which is normal. The skill does write output artifacts under a local output/ path as documented; no evidence it alters other skills or global agent settings.

如何使用

确保已安装 OpenClaw（本地或 Docker 部署）
在对话框中输入安装命令：/install alicloud-platform-multicloud-docs-api-benchmark
安装完成后，直接呼叫该 Skill 的名称或使用 /alicloud-platform-multicloud-docs-api-benchmark 触发
根据 Skill 的参数说明提供必要输入，即可获得结构化输出

版本历史

v1.0.1

batch publish from alicloud-skills on 2026-03-11

v1.0.0

- Initial release of the multi-cloud product and API documentation benchmarking tool. - Supports automatic discovery and comparison of official documentation for Alibaba Cloud, AWS, Azure, GCP, Tencent Cloud, Volcano Engine, and Huawei Cloud. - Scores documentation quality and generates detailed, prioritized improvement recommendations. - Allows users to manually pin authoritative documentation links per provider for stricter comparisons. - Outputs results as structured evidence and Markdown reports in the designated output directory. - Flexible scoring profiles and preset matching for specific use cases like LLM platform benchmarks. - Guidance included for report generation and handling low-confidence discovery scenarios.

元数据

Slug alicloud-platform-multicloud-docs-api-benchmark

版本 1.0.1

许可证 MIT-0

累计安装 2

当前安装数 2

历史版本数 2

常见问题