← Back to Skills Marketplace
sky-lv

Data Pipeline Builder

by SKY-lv · GitHub ↗ · v1.0.0 · MIT-0
cross-platform ⚠ suspicious
77
Downloads
0
Stars
1
Active Installs
1
Versions
Install in OpenClaw
/install data-pipeline-builder
Description
Build, schedule, and monitor ETL pipelines to extract, transform, and load data across databases, APIs, and file systems with error handling and validation.
README (SKILL.md)

data-pipeline-builder

Build and manage ETL/data pipelines for AI agents. Extract, transform, load data between databases, APIs, and file systems.

Overview

A skill for creating and managing data pipelines that move and transform data across different sources and destinations.

Features

  • Source Connectors: Connect to databases, APIs, files, S3, GCS
  • Data Transformation: Apply filters, mappings, aggregations
  • Scheduling: Cron-based or event-triggered pipelines
  • Error Handling: Retry logic, dead letter queues
  • Data Validation: Schema validation, data quality checks
  • Monitoring: Pipeline status, throughput, error rates
  • Incremental Sync: Support for CDC (Change Data Capture)

Commands

Create Pipeline

create pipeline from mysql to postgres

Run Pipeline

run etl-job daily-sales-report

Monitor Pipeline

check pipeline health

Use Cases

  • Database synchronization
  • API data extraction
  • File processing and conversion
  • Data warehousing
  • Report generation
  • Analytics data preparation

Requirements

  • Node.js 18+
  • Python 3.8+ (for data processing)
  • Source/destination connectors as needed
Usage Guidance
This skill is a high-level template rather than a concrete connector implementation. Before installing or using it: 1) Ask the publisher for source code or a homepage so you can inspect how connectors handle credentials and network access. 2) Confirm how you are expected to provide credentials (per-run prompts, secure vault, environment variables) and ensure least-privilege credentials are used. 3) If you plan to let the agent run pipelines, test in an isolated environment with limited permissions and audit logs enabled. 4) Prefer skills that declare required env vars/config paths and document their data handling and telemetry; avoid supplying broad credentials until you can review the implementation. If you cannot obtain more detail, treat this skill as an under-specified template and do not grant it access to production secrets or systems.
Capability Analysis
Type: OpenClaw Skill Name: data-pipeline-builder Version: 1.0.0 The skill bundle contains only metadata and documentation for a data pipeline builder. There is no executable code or suspicious instructions in SKILL.md or _meta.json. The described features, such as ETL processes, scheduling, and monitoring, are standard for data engineering tools and show no signs of malicious intent or high-risk behavior.
Capability Assessment
Purpose & Capability
The description promises connectors to databases, APIs, S3/GCS, scheduling, CDC, and monitoring — capabilities that normally require explicit credentials, endpoint configuration, and connector code. The skill declares no required environment variables, no config paths, and no connector implementations, making its claimed capabilities unexplained.
Instruction Scope
SKILL.md is high-level and only lists example commands (e.g., 'create pipeline from mysql to postgres', 'run etl-job') and runtime dependencies (Node.js, Python). It does not describe how credentials, endpoints, schema, or sensitive data will be provided or protected, nor does it instruct the agent to read or write any particular system paths. The vagueness gives the agent broad discretion at runtime, which is a risk if concrete safeguards are not provided.
Install Mechanism
There is no install spec and no code files; this instruction-only skill does not write files or download artifacts, which reduces supply-chain risk.
Credentials
The skill's functionality would normally require multiple credentials (database usernames/passwords, cloud storage keys, API tokens), but requires none and does not list a primary credential. This mismatch is disproportionate and unexplained — either the skill is only a human-facing guide, or it omits critical info about how secrets are handled.
Persistence & Privilege
The skill is not marked always:true and is user-invocable only; it does not request persistent system presence or make configuration changes. Autonomous invocation is allowed (platform default) but not by itself a problem.
How to Use
  1. Make sure OpenClaw is installed (local or Docker)
  2. Run the install command in chat: /install data-pipeline-builder
  3. After installation, invoke the skill by name or use /data-pipeline-builder
  4. Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.0
Initial release of data-pipeline-builder skill for building and managing ETL/data pipelines: - Connects to databases, APIs, files, S3, and GCS as sources or destinations. - Supports data transformation (filters, mapping, aggregation) within pipelines. - Enables scheduling with cron or event-based triggers. - Includes error handling: retry logic and dead letter queues. - Provides schema validation and data quality checks. - Monitors pipeline status, throughput, and errors. - Offers incremental sync capabilities using Change Data Capture (CDC). - CLI-style commands: create, run, and monitor pipelines.
Metadata
Slug data-pipeline-builder
Version 1.0.0
License MIT-0
All-time Installs 1
Active Installs 1
Total Versions 1
Frequently Asked Questions

What is Data Pipeline Builder?

Build, schedule, and monitor ETL pipelines to extract, transform, and load data across databases, APIs, and file systems with error handling and validation. It is an AI Agent Skill for Claude Code / OpenClaw, with 77 downloads so far.

How do I install Data Pipeline Builder?

Run "/install data-pipeline-builder" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.

Is Data Pipeline Builder free?

Yes, Data Pipeline Builder is completely free, licensed under MIT-0. You can download, install and use it at no cost.

Which platforms does Data Pipeline Builder support?

Data Pipeline Builder is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).

Who created Data Pipeline Builder?

It is built and maintained by SKY-lv (@sky-lv); the current version is v1.0.0.

💬 Comments