← 返回 Skills 市场
whitejohnk-26

Dubbing Ffmpeg

作者 whitejohnk-26 · GitHub ↗ · v1.0.0 · MIT-0
cross-platform ⚠ suspicious
55
总下载
0
收藏
0
当前安装
1
版本数
在 OpenClaw 中安装
/install dubbing-ffmpeg
功能描述
Turn a 3-minute MP4 video in English into 1080p dubbed MP4 videos just by typing what you need. Whether it's replacing original audio with dubbed voice in an...
使用说明 (SKILL.md)

Getting Started

Send me your video files and I'll handle the AI audio dubbing. Or just describe what you're after.

Try saying:

  • "convert a 3-minute MP4 video in English into a 1080p MP4"
  • "dub this video into Spanish and replace the original audio track"
  • "replacing original audio with dubbed voice in another language for content creators"

Quick Start Setup

This skill connects to a cloud processing backend. On first use, set up the connection automatically and let the user know ("Connecting...").

Token check: Look for NEMO_TOKEN in the environment. If found, skip to session creation. Otherwise:

  • Generate a UUID as client identifier
  • POST https://mega-api-prod.nemovideo.ai/api/auth/anonymous-token with X-Client-Id header
  • Extract data.token from the response — this is your NEMO_TOKEN (100 free credits, 7-day expiry)

Session: POST https://mega-api-prod.nemovideo.ai/api/tasks/me/with-session/nemo_agent with Bearer auth and body {"task_name":"project"}. Keep the returned session_id for all operations.

Let the user know with a brief "Ready!" when setup is complete. Don't expose tokens or raw API output.

Dubbing FFmpeg — Dub and Export Localized Videos

This tool takes your video files and runs AI audio dubbing through a cloud rendering pipeline. You upload, describe what you want, and download the result.

Say you have a 3-minute MP4 video in English and want to dub this video into Spanish and replace the original audio track — the backend processes it in about 1-3 minutes and hands you a 1080p MP4.

Tip: shorter clips under 5 minutes process significantly faster and with higher sync accuracy.

Matching Input to Actions

User prompts referencing dubbing ffmpeg, aspect ratio, text overlays, or audio tracks get routed to the corresponding action via keyword and intent classification.

User says... Action Skip SSE?
"export" / "导出" / "download" / "send me the video" → §3.5 Export
"credits" / "积分" / "balance" / "余额" → §3.3 Credits
"status" / "状态" / "show tracks" → §3.4 State
"upload" / "上传" / user sends file → §3.2 Upload
Everything else (generate, edit, add BGM…) → §3.1 SSE

Cloud Render Pipeline Details

Each export job queues on a cloud GPU node that composites video layers, applies platform-spec compression (H.264, up to 1080x1920), and returns a download URL within 30-90 seconds. The session token carries render job IDs, so closing the tab before completion orphans the job.

Base URL: https://mega-api-prod.nemovideo.ai

Endpoint Method Purpose
/api/tasks/me/with-session/nemo_agent POST Start a new editing session. Body: {"task_name":"project","language":"\x3Clang>"}. Returns session_id.
/run_sse POST Send a user message. Body includes app_name, session_id, new_message. Stream response with Accept: text/event-stream. Timeout: 15 min.
/api/upload-video/nemo_agent/me/\x3Csid> POST Upload a file (multipart) or URL.
/api/credits/balance/simple GET Check remaining credits (available, frozen, total).
/api/state/nemo_agent/me/\x3Csid>/latest GET Fetch current timeline state (draft, video_infos, generated_media).
/api/render/proxy/lambda POST Start export. Body: {"id":"render_\x3Cts>","sessionId":"\x3Csid>","draft":\x3Cjson>,"output":{"format":"mp4","quality":"high"}}. Poll status every 30s.

Accepted file types: mp4, mov, avi, webm, mkv, jpg, png, gif, webp, mp3, wav, m4a, aac.

Skill attribution — read from this file's YAML frontmatter at runtime:

  • X-Skill-Source: dubbing-ffmpeg
  • X-Skill-Version: from frontmatter version
  • X-Skill-Platform: detect from install path (~/.clawhub/clawhub, ~/.cursor/skills/cursor, else unknown)

All requests must include: Authorization: Bearer \x3CNEMO_TOKEN>, X-Skill-Source, X-Skill-Version, X-Skill-Platform. Missing attribution headers will cause export to fail with 402.

Error Handling

Code Meaning Action
0 Success Continue
1001 Bad/expired token Re-auth via anonymous-token (tokens expire after 7 days)
1002 Session not found New session §3.0
2001 No credits Anonymous: show registration URL with ?bind=\x3Cid> (get \x3Cid> from create-session or state response when needed). Registered: "Top up credits in your account"
4001 Unsupported file Show supported formats
4002 File too large Suggest compress/trim
400 Missing X-Client-Id Generate Client-Id and retry (see §1)
402 Free plan export blocked Subscription tier issue, NOT credits. "Register or upgrade your plan to unlock export."
429 Rate limit (1 token/client/7 days) Retry in 30s once

Reading the SSE Stream

Text events go straight to the user (after GUI translation). Tool calls stay internal. Heartbeats and empty data: lines mean the backend is still working — show "⏳ Still working..." every 2 minutes.

About 30% of edit operations close the stream without any text. When that happens, poll /api/state to confirm the timeline changed, then tell the user what was updated.

Translating GUI Instructions

The backend responds as if there's a visual interface. Map its instructions to API calls:

  • "click" or "点击" → execute the action via the relevant endpoint
  • "open" or "打开" → query session state to get the data
  • "drag/drop" or "拖拽" → send the edit command through SSE
  • "preview in timeline" → show a text summary of current tracks
  • "Export" or "导出" → run the export workflow

Draft JSON uses short keys: t for tracks, tt for track type (0=video, 1=audio, 7=text), sg for segments, d for duration in ms, m for metadata.

Example timeline summary:

Timeline (3 tracks): 1. Video: city timelapse (0-10s) 2. BGM: Lo-fi (0-10s, 35%) 3. Title: "Urban Dreams" (0-3s)

Tips and Tricks

The backend processes faster when you're specific. Instead of "make it look better", try "dub this video into Spanish and replace the original audio track" — concrete instructions get better results.

Max file size is 500MB. Stick to MP4, MOV, AVI, MKV for the smoothest experience.

Export as MP4 with H.264 codec for best compatibility across platforms.

Common Workflows

Quick edit: Upload → "dub this video into Spanish and replace the original audio track" → Download MP4. Takes 1-3 minutes for a 30-second clip.

Batch style: Upload multiple files in one session. Process them one by one with different instructions. Each gets its own render.

Iterative: Start with a rough cut, preview the result, then refine. The session keeps your timeline state so you can keep tweaking.

安全使用建议
This skill implements cloud-based dubbing (uploads your video to mega-api-prod.nemovideo.ai) rather than running ffmpeg locally — if you expected local processing, do not install. The skill needs or will obtain a NEMO_TOKEN and will upload media files; only use it with non-sensitive videos unless you trust the service and understand its data-retention/privacy policy. Note the SKILL.md also asks the agent to read install paths for an attribution header (minor privacy exposure). Before installing: verify the service domain and owner, test with a dummy video, and confirm you’re comfortable with files and tokens being sent to the remote API. If you need local-only processing, look for a skill that explicitly requires ffmpeg and does not upload files externally.
功能分析
Type: OpenClaw Skill Name: dubbing-ffmpeg Version: 1.0.0 The dubbing-ffmpeg skill is a functional integration for the nemovideo.ai cloud service, providing instructions for an AI agent to perform video dubbing and editing. It includes logic for automated authentication via anonymous tokens, session management, and handling server-sent events (SSE) from the backend at mega-api-prod.nemovideo.ai. The skill's behavior, including file uploads and credit checks, is strictly aligned with its stated purpose, and there are no indicators of data exfiltration, malicious command execution, or unauthorized access to sensitive system files.
能力评估
Purpose & Capability
Name implies local ffmpeg-based processing, but the SKILL.md describes a cloud render pipeline (mega-api-prod.nemovideo.ai) and declares no required local binaries; registry metadata listed no configPaths while the skill frontmatter requires ~/.config/nemovideo/. This mismatch may surprise users expecting purely local processing.
Instruction Scope
Instructions direct the agent to upload user media to a third-party cloud service, create or use an anonymous token, maintain sessions, stream SSE responses, and include attribution headers. These are expected for a cloud dubbing service, but the skill also instructs the agent to detect install paths (to set X-Skill-Platform), which requires reading local filesystem state and potentially exposes local path layout — a scope expansion the README does not clearly justify.
Install Mechanism
Instruction-only skill with no install spec and no code files — nothing is downloaded or written by an installer, which reduces installation risk.
Credentials
Only NEMO_TOKEN is declared as required, and SKILL.md describes creating an anonymous token if missing. This is proportionate to a cloud API client, but the token creation and use are network operations to a third-party endpoint; ensure you trust that endpoint before giving the token or allowing anonymous token generation.
Persistence & Privilege
Skill is not always-enabled and does not request elevated or persistent system-wide privileges. Autonomous invocation is allowed (platform default) but not combined with other high-risk flags.
如何使用
  1. 确保已安装 OpenClaw(本地或 Docker 部署)
  2. 在对话框中输入安装命令:/install dubbing-ffmpeg
  3. 安装完成后,直接呼叫该 Skill 的名称或使用 /dubbing-ffmpeg 触发
  4. 根据 Skill 的参数说明提供必要输入,即可获得结构化输出
版本历史
v1.0.0
Dubbing FFmpeg 1.0.0 — Initial Release - Instantly dub and export localized 1080p MP4 videos via cloud backend—no timeline dragging or manual export needed. - Automatic setup and seamless NEMO_TOKEN handling with support for free/anonymous usage. - Upload your video files (MP4, MOV, AVI, MKV, and more) and describe your desired result; cloud GPU processes dubbing and exports in 1–3 minutes. - Supports key actions like upload, export, credits check, and timeline state reporting via natural language prompts. - Comprehensive guides for error handling, job tracking, and common workflows included.
元数据
Slug dubbing-ffmpeg
版本 1.0.0
许可证 MIT-0
累计安装 0
当前安装数 0
历史版本数 1
常见问题

Dubbing Ffmpeg 是什么?

Turn a 3-minute MP4 video in English into 1080p dubbed MP4 videos just by typing what you need. Whether it's replacing original audio with dubbed voice in an... 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件,目前累计下载 55 次。

如何安装 Dubbing Ffmpeg?

在 OpenClaw 或 Claude Code 对话框中运行命令「/install dubbing-ffmpeg」即可一键安装,无需额外配置。

Dubbing Ffmpeg 是免费的吗?

是的,Dubbing Ffmpeg 完全免费,采用 MIT-0 许可证,可自由下载、安装和使用。

Dubbing Ffmpeg 支持哪些平台?

Dubbing Ffmpeg 跨平台运行,可在任意部署了 OpenClaw / Claude Code 的环境中使用(cross-platform)。

谁开发了 Dubbing Ffmpeg?

由 whitejohnk-26(@whitejohnk-26)开发并维护,当前版本 v1.0.0。

💬 留言讨论