← Back to Skills Marketplace
Senior Data Engineer
by
Alireza Rezvani
· GitHub ↗
· v2.1.1
· MIT-0
2703
Downloads
3
Stars
15
Active Installs
2
Versions
Install in OpenClaw
/install senior-data-engineer
Description
Data engineering skill for building scalable data pipelines, ETL/ELT systems, and data infrastructure. Expertise in Python, SQL, Spark, Airflow, dbt, Kafka,...
Usage Guidance
This skill appears coherent for data-engineering tasks, but the bundle includes executable Python scripts—inspect those files (especially the three scripts) before running them. Run in a safe environment (local dev container or sandbox), verify any external connectors (Kafka, S3, Snowflake) are configured intentionally, and avoid running against production systems or with credentials present until you review network calls and file writes in the scripts.
Capability Analysis
Type: OpenClaw Skill
Name: senior-data-engineer
Version: 2.1.1
The senior-data-engineer skill bundle is a comprehensive and well-structured set of tools for data engineering workflows, including data validation, performance optimization, and pipeline orchestration. Analysis of the Python scripts (data_quality_validator.py, etl_performance_optimizer.py, and pipeline_orchestrator.py) reveals legitimate logic for data profiling, SQL parsing, and generating workflow configurations for Airflow, Prefect, and Dagster. There is no evidence of data exfiltration, malicious execution (e.g., eval/exec), or prompt injection attempts; the bundle strictly adheres to its stated purpose of assisting with production-grade data engineering tasks.
Capability Assessment
Purpose & Capability
Name/description (data pipelines, ETL, Spark, Airflow, dbt, Kafka) align with the included reference docs and the three Python scripts (pipeline orchestration, data quality, ETL performance). There are no declared env vars, binaries, or config paths that contradict the stated purpose.
Instruction Scope
SKILL.md instructs the agent to run bundled Python scripts and to read/write local pipeline files (dags, schemas, parquet, queries). That is coherent for this purpose, but executing the provided scripts runs arbitrary Python code and may access local files, connectors, or network endpoints described in examples—review the scripts before executing in sensitive environments.
Install Mechanism
No install spec is provided (instruction-only plus bundled scripts). Nothing is downloaded from external URLs and no extract/install steps are present.
Credentials
The skill requires no environment variables, credentials, or external config paths. Example code references typical endpoints (Kafka, S3, Delta paths) only as examples; no unrelated secrets are requested.
Persistence & Privilege
always is false and there is no indication the skill attempts to persistently modify agent/system configuration or other skills. Autonomous invocation is allowed (platform default) but not combined with other privileged behaviors.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install senior-data-engineer - After installation, invoke the skill by name or use
/senior-data-engineer - Provide required inputs per the skill's parameter spec and get structured output
Version History
v2.1.1
v2.1.1: optimization, reference splits
v1.0.0
Senior Data Engineer skill version 1.0.0 initial release:
- Launches production-grade data engineering capabilities focused on scalable pipelines, ETL/ELT, and modern data stack.
- Provides trigger phrases, quick start commands, and tool references for common tasks.
- Includes detailed workflows for batch ETL, real-time streaming, and data quality frameworks.
- Covers architecture decision guidance, tech stack overview, and troubleshooting resources.
- Suitable for designing architectures, building pipelines, optimizing workflows, and implementing data governance.
Metadata
Frequently Asked Questions
What is Senior Data Engineer?
Data engineering skill for building scalable data pipelines, ETL/ELT systems, and data infrastructure. Expertise in Python, SQL, Spark, Airflow, dbt, Kafka,... It is an AI Agent Skill for Claude Code / OpenClaw, with 2703 downloads so far.
How do I install Senior Data Engineer?
Run "/install senior-data-engineer" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Senior Data Engineer free?
Yes, Senior Data Engineer is completely free, licensed under MIT-0. You can download, install and use it at no cost.
Which platforms does Senior Data Engineer support?
Senior Data Engineer is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created Senior Data Engineer?
It is built and maintained by Alireza Rezvani (@alirezarezvani); the current version is v2.1.1.
More Skills