← Back to Skills Marketplace
hgta23

A/B Testing Tool Skill

by bittao · GitHub ↗ · v1.0.0 · MIT-0
cross-platform ⚠ suspicious
171
Downloads
0
Stars
0
Active Installs
1
Versions
Install in OpenClaw
/install ab
Description
Design, run, and analyze A/B tests to compare content variants, measure performance, and make data-driven optimization decisions.
README (SKILL.md)

name: ab

version: 1.0.0

description: "A/B testing tool for designing, running, and analyzing A/B tests. Use when: user wants to test different versions of content, measure performance, and make data-driven decisions."


A/B Testing Tool Skill

Powerful A/B testing tool for designing, running, and analyzing A/B tests to optimize content and make data-driven decisions.

Features

  • Test Design: Create and configure A/B tests with multiple variants
  • Data Collection: Track user interactions and performance metrics
  • Statistical Analysis: Analyze test results with confidence intervals
  • Result Reporting: Generate comprehensive test reports
  • Optimization Recommendations: Get suggestions based on test results

Use Cases

  • Test different website designs or landing pages
  • Compare email subject lines or marketing copy
  • Evaluate different UI elements or user flows
  • Optimize conversion rates for e-commerce
  • Test content effectiveness for blog posts or articles

How to Use

  1. Define your test goal and metrics
  2. Create test variants
  3. Set test parameters (sample size, duration)
  4. Run the test and collect data
  5. Analyze results and make decisions

Example

# Create a new A/B test
ab create --name "Landing Page Test" --variants A B

# Set test metrics
ab metrics --test "Landing Page Test" --metrics conversion_rate time_on_page

# Start the test
ab start --test "Landing Page Test"

# Analyze results
ab analyze --test "Landing Page Test"

Benefits

  • Make data-driven decisions instead of relying on intuition
  • Optimize content and design for better performance
  • Reduce risk by testing changes before full implementation
  • Gain insights into user behavior and preferences
  • Improve conversion rates and user engagement

Supported Platforms

  • Websites and web applications
  • Email marketing campaigns
  • Mobile applications
  • Social media content
  • E-commerce product pages

Requirements

  • Basic understanding of A/B testing principles
  • Access to the platform where you want to run tests
  • Sufficient traffic or users to get meaningful results
Usage Guidance
This skill appears to be a simple, local CLI for managing A/B tests and is internally consistent. Before installing or running it: 1) ensure you have Node.js available (the package.json lists dependencies) and run npm install in the skill folder or confirm the platform will install deps; 2) inspect the included index.js yourself (it writes JSON files to a tests/ subdirectory inside the skill folder) and run it in a sandbox if you are unsure; 3) note the source/owner and homepage are unknown — if you require provenance, request a published source or repo; 4) because it writes files locally, back up any important directories you might point it at. There are no signs of credential exfiltration or external network calls in the provided code.
Capability Analysis
Type: OpenClaw Skill Name: ab Version: 1.0.0 The skill contains a path traversal vulnerability in index.js. The CLI commands (create, metrics, start, analyze, add-data) use user-provided input from the --test and --name arguments to construct file paths using path.join() without sanitizing directory traversal sequences like '../', potentially allowing an attacker to read or write JSON files outside the intended 'tests/' directory.
Capability Assessment
Purpose & Capability
Name/description (A/B testing) aligns with the included CLI implementation: create tests, set metrics, start, add data, analyze. Behavior and data model in index.js match SKILL.md. One small mismatch: SKILL metadata lists no required binaries, but the tool is a Node.js script and depends on Node and npm-installed packages.
Instruction Scope
SKILL.md instructs using the local 'ab' CLI and describes steps that map directly to the commands implemented in index.js. The runtime instructions do not ask the agent to read unrelated files, access credentials, or transmit data externally.
Install Mechanism
There is no install spec (instruction-only), but code and package.json are included. The package.json lists dependencies (commander, chalk, fs-extra) which must be installed (e.g., npm install) and the runtime requires Node. The lack of an install step or declared Node requirement is a minor inconsistency to be aware of but not an active risk.
Credentials
The skill declares no environment variables or credentials and the code does not read env vars or external config. No sensitive-scoped variables are requested, which is proportionate to an offline testing CLI.
Persistence & Privilege
The script creates and writes JSON files under its own tests directory (path: __dirname/tests). This is reasonable for local test state, but users should know it writes files to the skill's directory. always is false and the skill does not modify other skills or system-wide settings.
How to Use
  1. Make sure OpenClaw is installed (local or Docker)
  2. Run the install command in chat: /install ab
  3. After installation, invoke the skill by name or use /ab
  4. Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.0
Initial release of the A/B Testing Tool skill. - Design, run, and analyze A/B tests with multiple variants. - Track user interactions and measure key performance metrics. - Perform statistical analysis with confidence intervals. - Generate comprehensive reports and receive optimization recommendations. - Supports use on websites, email campaigns, mobile apps, social media, and more.
Metadata
Slug ab
Version 1.0.0
License MIT-0
All-time Installs 0
Active Installs 0
Total Versions 1
Frequently Asked Questions

What is A/B Testing Tool Skill?

Design, run, and analyze A/B tests to compare content variants, measure performance, and make data-driven optimization decisions. It is an AI Agent Skill for Claude Code / OpenClaw, with 171 downloads so far.

How do I install A/B Testing Tool Skill?

Run "/install ab" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.

Is A/B Testing Tool Skill free?

Yes, A/B Testing Tool Skill is completely free, licensed under MIT-0. You can download, install and use it at no cost.

Which platforms does A/B Testing Tool Skill support?

A/B Testing Tool Skill is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).

Who created A/B Testing Tool Skill?

It is built and maintained by bittao (@hgta23); the current version is v1.0.0.

💬 Comments