← Back to Skills Marketplace
81
Downloads
0
Stars
0
Active Installs
1
Versions
Install in OpenClaw
/install aliyun-platform-docs-benchmark
Description
Use when benchmarking similar product documentation and API documentation across Alibaba Cloud, AWS, Azure, GCP, Tencent Cloud, Volcano Engine, and Huawei Cl...
README (SKILL.md)
Multi-Cloud Product Docs/API Benchmark
Use this skill when the user wants cross-cloud documentation/API comparison for similar products.
Supported clouds
- Alibaba Cloud
- AWS
- Azure
- GCP
- Tencent Cloud
- Volcano Engine
- Huawei Cloud
Data source policy
L0(highest): user-pinned official links via--\x3Cprovider>-linksL1: machine-readable official metadata/source- GCP: Discovery API
- AWS: API Models repository
- Azure: REST API Specs repository
L2: official-domain constrained web discovery fallbackL3: insufficient discovery (low confidence)
Workflow
Run the benchmark script:
python skills/platform/docs/aliyun-platform-docs-benchmark/scripts/benchmark_multicloud_docs_api.py --product "\x3Cproduct keyword>"
Example:
python skills/platform/docs/aliyun-platform-docs-benchmark/scripts/benchmark_multicloud_docs_api.py --product "serverless"
LLM platform benchmark example (Bailian/Bedrock/Azure OpenAI/Vertex AI/Hunyuan/Ark/Pangu):
python skills/platform/docs/aliyun-platform-docs-benchmark/scripts/benchmark_multicloud_docs_api.py --product "Bailian" --preset "llm-platform"
If --preset is omitted, script attempts to auto-match preset based on keyword.
Scoring weights can be switched by profile (see references/scoring.json):
python skills/platform/docs/aliyun-platform-docs-benchmark/scripts/benchmark_multicloud_docs_api.py --product "Bailian" --preset "llm-platform" --scoring-profile "llm-platform"
Optional: pin authoritative links
Auto-discovery may miss pages. For stricter comparison, pass official links manually:
python skills/platform/docs/aliyun-platform-docs-benchmark/scripts/benchmark_multicloud_docs_api.py \
--product "object storage" \
--aws-links "https://docs.aws.amazon.com/AmazonS3/latest/userguide/Welcome.html" \
--azure-links "https://learn.microsoft.com/azure/storage/blobs/"
Available manual flags:
--alicloud-links--aws-links--azure-links--gcp-links--tencent-links--volcengine-links--huawei-links
Each flag accepts comma-separated URLs.
Output policy
All artifacts must be written under:
output/aliyun-platform-docs-benchmark/
Per run:
benchmark_evidence.jsonbenchmark_report.md
Reporting guidance
When answering the user:
- Show score ranking across all providers.
- Highlight top gaps (P0/P1/P2) and concrete fix actions.
- If discovery confidence is low, ask user to provide pinned links and rerun.
Validation
mkdir -p output/aliyun-platform-docs-benchmark
for f in skills/platform/docs/aliyun-platform-docs-benchmark/scripts/*.py; do
python3 -m py_compile "$f"
done
echo "py_compile_ok" > output/aliyun-platform-docs-benchmark/validate.txt
Pass criteria: command exits 0 and output/aliyun-platform-docs-benchmark/validate.txt is generated.
Output And Evidence
- Save artifacts, command outputs, and API response summaries under
output/aliyun-platform-docs-benchmark/. - Include key parameters (region/resource id/time range) in evidence files for reproducibility.
Prerequisites
- Configure least-privilege Alibaba Cloud credentials before execution.
- Prefer environment variables:
ALICLOUD_ACCESS_KEY_ID,ALICLOUD_ACCESS_KEY_SECRET, optionalALICLOUD_REGION_ID. - If region is unclear, ask the user before running mutating operations.
References
- Rubric:
references/review-rubric.md
Usage Guidance
This skill appears to implement a reasonable multi-cloud docs benchmarking tool, but there are two things to check before running it: (1) the SKILL.md asks you to provide Alibaba Cloud credentials (ALICLOUD_ACCESS_KEY_ID / ALICLOUD_ACCESS_KEY_SECRET) and optional region, yet the skill manifest does not declare any required environment variables—ask the author to explicitly declare these env vars in the skill metadata and explain exactly what API calls require them. (2) Inspect the Python script for any operations that modify cloud resources or send data to external endpoints (it performs web/API discovery and writes an output directory; confirm it does not call any mutating APIs or post sensitive evidence elsewhere). If you must run it, use isolated/least-privilege test credentials, avoid using production secrets, prefer providing pinned official links instead of credentials when possible, and run the script in an isolated environment so you can review generated output before sharing it.
Capability Analysis
Type: OpenClaw Skill
Name: aliyun-platform-docs-benchmark
Version: 1.0.0
The skill bundle is classified as suspicious because SKILL.md instructs the agent and user to configure sensitive Alibaba Cloud credentials (ALICLOUD_ACCESS_KEY_ID and ALICLOUD_ACCESS_KEY_SECRET) as a prerequisite, despite the provided script (benchmark_multicloud_docs_api.py) only performing read-only operations on public documentation and metadata APIs. The script itself appears functional, using urllib to query DuckDuckGo, GitHub, and public Alibaba Cloud endpoints, but it never utilizes the requested credentials. This discrepancy suggests either a poorly constructed template or a potential credential-fishing attempt by encouraging the placement of secrets into the environment where they are not required for the stated task.
Capability Assessment
Purpose & Capability
Name/description (multi-cloud docs/API benchmark) align with included code and resources (discovery, scoring, presets). Requesting Alibaba Cloud metadata as an optional enrichment is plausible for an 'Aliyun' branded benchmark, but the skill metadata declares no required env vars while the runtime instructions explicitly request ALICLOUD_* credentials — an inconsistency.
Instruction Scope
SKILL.md instructs the agent to run a local Python script that performs web discovery and API calls and to 'configure least-privilege Alibaba Cloud credentials' and include region/resource id/time range in evidence. It also warns to ask the user before running mutating operations, which implies possible non-read-only interactions. The instructions therefore reach beyond pure passive scraping and could touch cloud APIs or collect sensitive parameters; those behaviors are not fully declared or scoped in the manifest.
Install Mechanism
No install spec; skill is instruction + Python script relying on standard library (urllib, json, re). No third-party packages or external binary downloads were declared, which is proportional and lower-risk.
Credentials
The manifest lists no required environment variables, but SKILL.md asks for ALICLOUD_ACCESS_KEY_ID / ALICLOUD_ACCESS_KEY_SECRET (and optional region). Requesting cloud credentials (even 'least-privilege') is sensitive and should be declared in requires.env; currently the credential request is undocumented in the metadata and therefore disproportionate/untracked.
Persistence & Privilege
always:false and no install hooks were declared. The skill does write output artifacts to a local output/ directory per its instructions, which is expected for a benchmarking script. It does not request permanent platform-level privileges in the manifest.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install aliyun-platform-docs-benchmark - After installation, invoke the skill by name or use
/aliyun-platform-docs-benchmark - Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.0
Initial release of aliyun-platform-docs-benchmark.
- Enables benchmarking of product and API documentation across major cloud providers (Alibaba Cloud, AWS, Azure, GCP, Tencent Cloud, Volcano Engine, Huawei Cloud).
- Automatically discovers, scores, and compares documentation links given a product keyword.
- Outputs detailed, prioritized improvement recommendations and scoring breakdowns.
- Supports manual pinning of authoritative links to ensure strict comparison.
- Artifacts and reports are saved under a dedicated output directory for traceability and reproducibility.
- Includes validation steps and configuration guidance for cloud credentials.
Metadata
Frequently Asked Questions
What is Aliyun Platform Docs Benchmark?
Use when benchmarking similar product documentation and API documentation across Alibaba Cloud, AWS, Azure, GCP, Tencent Cloud, Volcano Engine, and Huawei Cl... It is an AI Agent Skill for Claude Code / OpenClaw, with 81 downloads so far.
How do I install Aliyun Platform Docs Benchmark?
Run "/install aliyun-platform-docs-benchmark" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Aliyun Platform Docs Benchmark free?
Yes, Aliyun Platform Docs Benchmark is completely free, licensed under MIT-0. You can download, install and use it at no cost.
Which platforms does Aliyun Platform Docs Benchmark support?
Aliyun Platform Docs Benchmark is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created Aliyun Platform Docs Benchmark?
It is built and maintained by cinience (@cinience); the current version is v1.0.0.
More Skills