← 返回 Skills 市场

Data Pipeline Toolkit

Name: Data Pipeline Toolkit
Author: sunshine-del-ux

作者 Sunshine-del-ux · GitHub ↗ · v1.0.0

cross-platform ⚠ suspicious

614

总下载

当前安装

版本数

在 OpenClaw 中安装

/install data-pipeline-toolkit

功能描述

Create, schedule, and monitor ETL pipelines extracting from APIs, databases, files, and streams, with transform and load support to warehouses and APIs.

使用说明 (SKILL.md)

Data Pipeline Toolkit

Build ETL pipelines in minutes.

Features

Extract - APIs, databases, files, streams
Transform - Clean, filter, aggregate, join
Load - Data warehouses, databases, APIs
Scheduling - Cron-based or event-driven
Monitoring - Alerts on failures

Quick Start

# Create pipeline
./pipeline.sh create my-pipeline

# Add extract step
./pipeline.sh extract my-pipeline api --url https://api.example.com

# Add transform
./pipeline.sh transform my-pipeline filter "age > 18"

# Add load
./pipeline.sh load my-pipeline postgres --connection $DB_URL

# Run
./pipeline.sh run my-pipeline

Sources

REST APIs
GraphQL
SQL Databases
CSV/JSON/Parquet files
S3/Google Cloud Storage
Kafka/SQS

Destinations

PostgreSQL/MySQL
Snowflake/BigQuery
S3
APIs
Data warehouses

Requirements

Python 3.8+
Docker (optional)

Author

Sunshine-del-ux

安全使用建议

This skill is a documentation stub rather than a runnable tool: it references ./pipeline.sh and $DB_URL but includes no code or install instructions. Do not provide credentials or set DB_URL for this skill. Before installing or using it, ask the author for: (1) the pipeline.sh (or a clear install procedure), (2) a list of exact environment variables/credentials required and why, and (3) the source/homepage or repository so you can review the implementation. If you must test it, run any provided scripts in an isolated sandbox or disposable environment and inspect the script contents first. Prefer skills that include code or an install mechanism and that explicitly declare required credentials and their scope.

功能分析

Type: OpenClaw Skill Name: data-pipeline-toolkit Version: 1.0.0 The skill bundle consists of standard metadata and documentation (SKILL.md) for a data pipeline toolkit. The documentation describes typical ETL (Extract, Transform, Load) operations and command-line usage for a script named pipeline.sh. No executable code or malicious instructions were found in the provided files.

能力评估

⚠ Purpose & Capability

The description promises a full ETL toolkit, but the package contains no code, binaries, or install instructions. The Quick Start assumes a local executable (./pipeline.sh) that is not included. That mismatch means the skill cannot actually provide the claimed capabilities without external artifacts.

⚠ Instruction Scope

Runtime instructions tell the agent to run ./pipeline.sh create/extract/transform/load/run and reference an environment variable ($DB_URL) and external endpoints (https://api.example.com). The SKILL.md does not explain where pipeline.sh comes from, how to install it, or which credentials are required. The instructions are therefore vague and depend on unspecified external files.

ℹ Install Mechanism

There is no install spec (instruction-only), so nothing will be written to disk by installing the skill — this reduces install risk but also means the skill provides no runnable implementation. The lack of an install path is a functional gap rather than a security-safe implementation.

⚠ Credentials

The SKILL.md uses $DB_URL when demonstrating load steps but the skill declares no required environment variables or primary credential. Several sources/destinations are listed (S3, GCS, Kafka, Snowflake, BigQuery) but no credentials or config paths are requested or documented. That mismatch is a red flag: the skill will need secrets in practice, but none are declared.

✓ Persistence & Privilege

The skill does not request persistent presence (always: false) and allows normal model invocation. It does not declare any config paths or system modifications. There are no elevated privileges requested.

如何使用

确保已安装 OpenClaw（本地或 Docker 部署）
在对话框中输入安装命令：/install data-pipeline-toolkit
安装完成后，直接呼叫该 Skill 的名称或使用 /data-pipeline-toolkit 触发
根据 Skill 的参数说明提供必要输入，即可获得结构化输出

版本历史

v1.0.0

Initial release of Data Pipeline Toolkit. - Build ETL pipelines quickly via CLI. - Supports extracting data from APIs, databases, files, and streams. - Transform data with cleaning, filtering, aggregation, and joins. - Load data to warehouses, databases, and APIs. - Includes cron-based or event-driven scheduling and failure monitoring. - Compatible with Python 3.8+ (Docker optional).

元数据

Slug data-pipeline-toolkit

版本 1.0.0

许可证 —

累计安装 11

当前安装数 11

历史版本数 1

常见问题