← Back to Skills Marketplace
794
Downloads
2
Stars
2
Active Installs
2
Versions
Install in OpenClaw
/install alicloud-platform-multicloud-docs-api-benchmark
Description
Benchmark similar product documentation and API documentation across Alibaba Cloud, AWS, Azure, GCP, Tencent Cloud, Volcano Engine, and Huawei Cloud. Given o...
README (SKILL.md)
Multi-Cloud Product Docs/API Benchmark
Use this skill when the user wants cross-cloud documentation/API comparison for similar products.
Supported clouds
- Alibaba Cloud
- AWS
- Azure
- GCP
- Tencent Cloud
- Volcano Engine
- Huawei Cloud
Data source policy
L0(highest): user-pinned official links via--\x3Cprovider>-linksL1: machine-readable official metadata/source- GCP: Discovery API
- AWS: API Models repository
- Azure: REST API Specs repository
L2: official-domain constrained web discovery fallbackL3: insufficient discovery (low confidence)
Workflow
Run the benchmark script:
python skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/benchmark_multicloud_docs_api.py --product "\x3Cproduct keyword>"
Example:
python skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/benchmark_multicloud_docs_api.py --product "serverless"
LLM platform benchmark example (Bailian/Bedrock/Azure OpenAI/Vertex AI/Hunyuan/Ark/Pangu):
python skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/benchmark_multicloud_docs_api.py --product "Bailian" --preset "llm-platform"
If --preset is omitted, script attempts to auto-match preset based on keyword.
Scoring weights can be switched by profile (see references/scoring.json):
python skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/benchmark_multicloud_docs_api.py --product "Bailian" --preset "llm-platform" --scoring-profile "llm-platform"
Optional: pin authoritative links
Auto-discovery may miss pages. For stricter comparison, pass official links manually:
python skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/benchmark_multicloud_docs_api.py \
--product "object storage" \
--aws-links "https://docs.aws.amazon.com/AmazonS3/latest/userguide/Welcome.html" \
--azure-links "https://learn.microsoft.com/azure/storage/blobs/"
Available manual flags:
--alicloud-links--aws-links--azure-links--gcp-links--tencent-links--volcengine-links--huawei-links
Each flag accepts comma-separated URLs.
Output policy
All artifacts must be written under:
output/alicloud-platform-multicloud-docs-api-benchmark/
Per run:
benchmark_evidence.jsonbenchmark_report.md
Reporting guidance
When answering the user:
- Show score ranking across all providers.
- Highlight top gaps (P0/P1/P2) and concrete fix actions.
- If discovery confidence is low, ask user to provide pinned links and rerun.
Validation
mkdir -p output/alicloud-platform-multicloud-docs-api-benchmark
for f in skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/*.py; do
python3 -m py_compile "$f"
done
echo "py_compile_ok" > output/alicloud-platform-multicloud-docs-api-benchmark/validate.txt
Pass criteria: command exits 0 and output/alicloud-platform-multicloud-docs-api-benchmark/validate.txt is generated.
Output And Evidence
- Save artifacts, command outputs, and API response summaries under
output/alicloud-platform-multicloud-docs-api-benchmark/. - Include key parameters (region/resource id/time range) in evidence files for reproducibility.
Prerequisites
- Configure least-privilege Alibaba Cloud credentials before execution.
- Prefer environment variables:
ALICLOUD_ACCESS_KEY_ID,ALICLOUD_ACCESS_KEY_SECRET, optionalALICLOUD_REGION_ID. - If region is unclear, ask the user before running mutating operations.
References
- Rubric:
references/review-rubric.md
Usage Guidance
This skill appears to implement the advertised cross-cloud docs benchmarking, but there are two things you should confirm before installing or running it:
1) Clarify credential needs: SKILL.md asks for Alibaba Cloud credentials (ALICLOUD_ACCESS_KEY_ID / ALICLOUD_ACCESS_KEY_SECRET) but the skill metadata does not declare any required env vars. Ask the author why keys are needed, what API calls will be made with them, and whether the script can run in a read-only mode without credentials. Do not supply production credentials until you understand the exact API calls.
2) Limit sensitive outputs: The instructions ask you to include region/resource IDs/time ranges in evidence files. Decide whether those identifiers are safe to write to disk and share. Run the script in an isolated environment (throwaway account or limited-privilege keys) and review output/ files before sharing.
Other practical steps:
- Inspect the full script for any code paths that perform mutating operations (create/delete) or send data to unexpected endpoints. If unsure, run the provided validation (py_compile step) first and then run discovery with pinned links and a harmless product keyword.
- Request the maintainer update the package metadata to declare any required env vars (ALICLOUD_*) and explain exactly why they are needed.
If the author confirms the script only uses credentials for non-mutating metadata fetches and updates the manifest accordingly, the skill is more coherent; until then treat it with caution.
Capability Analysis
Type: OpenClaw Skill
Name: alicloud-platform-multicloud-docs-api-benchmark
Version: 1.0.1
The skill bundle is a legitimate benchmarking tool designed to compare product documentation across multiple cloud providers. The Python script (benchmark_multicloud_docs_api.py) discovers official documentation links using DuckDuckGo scraping, the GCP Discovery API, and GitHub code search, then analyzes the fetched content for quality indicators like 'quick start' or 'API reference' sections. While the SKILL.md mentions configuring Alibaba Cloud credentials, the provided code only interacts with public metadata endpoints and does not attempt to exfiltrate sensitive information, execute arbitrary commands, or establish persistence.
Capability Assessment
Purpose & Capability
Name/description and included script match the advertised function (discover and score cloud provider docs). However SKILL.md explicitly asks users to 'Configure least-privilege Alibaba Cloud credentials' (ALICLOUD_ACCESS_KEY_ID/ALICLOUD_ACCESS_KEY_SECRET) even though the skill's registry metadata lists no required environment variables or primary credential. Requesting provider credentials (for Alibaba Cloud) is not obviously necessary for a read-only docs discovery task unless the script calls Alibaba APIs — the metadata and manifest should declare that credential requirement but do not.
Instruction Scope
Runtime instructions are concrete (how to run script, where outputs go) and primarily read-only (web discovery, GCP Discovery API, GitHub code search, DuckDuckGo). However the SKILL.md asks to include 'region/resource id/time range' in evidence files and warns about 'mutating operations' — that encourages collection of potentially sensitive resource identifiers. The instructions also tell users to provide cloud credentials, which broadens scope beyond simple web scraping. The script writes output artifacts to disk under an output/ path, which is expected.
Install Mechanism
No install spec; the skill is instruction-only with a standalone Python script. This is the lowest install risk (nothing is downloaded or executed at install time). The script uses only Python stdlib networking (urllib), which is expected for a discovery/benchmark tool.
Credentials
SKILL.md requests ALICLOUD_ACCESS_KEY_ID, ALICLOUD_ACCESS_KEY_SECRET (and optional ALICLOUD_REGION_ID) but the manifest/registry shows no required environment variables or primary credential. Requiring cloud credentials for a documentation benchmark is plausible only if it fetches provider-specific API metadata that requires auth, but that intent is not clearly declared in metadata — this mismatch reduces transparency and could lead users to supply keys without an explicit need or justification.
Persistence & Privilege
The skill is not marked always:true and does not request system-wide persistence. It can be invoked autonomously (platform default), which is normal. The skill does write output artifacts under a local output/ path as documented; no evidence it alters other skills or global agent settings.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install alicloud-platform-multicloud-docs-api-benchmark - After installation, invoke the skill by name or use
/alicloud-platform-multicloud-docs-api-benchmark - Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.1
batch publish from alicloud-skills on 2026-03-11
v1.0.0
- Initial release of the multi-cloud product and API documentation benchmarking tool.
- Supports automatic discovery and comparison of official documentation for Alibaba Cloud, AWS, Azure, GCP, Tencent Cloud, Volcano Engine, and Huawei Cloud.
- Scores documentation quality and generates detailed, prioritized improvement recommendations.
- Allows users to manually pin authoritative documentation links per provider for stricter comparisons.
- Outputs results as structured evidence and Markdown reports in the designated output directory.
- Flexible scoring profiles and preset matching for specific use cases like LLM platform benchmarks.
- Guidance included for report generation and handling low-confidence discovery scenarios.
Metadata
Frequently Asked Questions
What is Alicloud Platform Multicloud Docs Api Benchmark?
Benchmark similar product documentation and API documentation across Alibaba Cloud, AWS, Azure, GCP, Tencent Cloud, Volcano Engine, and Huawei Cloud. Given o... It is an AI Agent Skill for Claude Code / OpenClaw, with 794 downloads so far.
How do I install Alicloud Platform Multicloud Docs Api Benchmark?
Run "/install alicloud-platform-multicloud-docs-api-benchmark" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Alicloud Platform Multicloud Docs Api Benchmark free?
Yes, Alicloud Platform Multicloud Docs Api Benchmark is completely free, licensed under MIT-0. You can download, install and use it at no cost.
Which platforms does Alicloud Platform Multicloud Docs Api Benchmark support?
Alicloud Platform Multicloud Docs Api Benchmark is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created Alicloud Platform Multicloud Docs Api Benchmark?
It is built and maintained by cinience (@cinience); the current version is v1.0.1.
More Skills