LoRA Toolkit
/install bytesagain-lora-toolkit
LoRA Toolkit
Configure and generate LoRA fine-tuning scripts for large language models. Supports Llama, Mistral, Qwen, Phi and other HuggingFace-compatible models.
Commands
config
Generate a LoRA training configuration for your model and hardware.
bash scripts/script.sh config --model llama3-8b --gpu 24gb --dataset 10000
Parameters:
--model— base model (llama3-8b, mistral-7b, qwen2-7b, phi3-mini, llama3-70b)--gpu— VRAM size (8gb, 16gb, 24gb, 40gb, 80gb)--dataset— number of training samples
estimate
Estimate VRAM usage, training time, and cost before starting.
bash scripts/script.sh estimate --model mistral-7b --gpu 16gb --dataset 5000 --epochs 3
generate
Generate a ready-to-run Python training script using HuggingFace PEFT + TRL.
bash scripts/script.sh generate --model llama3-8b --output train.py
validate
Check dataset format compatibility (Alpaca / ShareGPT / OpenAI Chat format).
bash scripts/script.sh validate --file dataset.json --format alpaca
recommend
Recommend the best base model for your use case and hardware.
bash scripts/script.sh recommend --task chat --gpu 16gb --language en
help
Show all commands.
bash scripts/script.sh help
LoRA Parameters Reference
| Model Size | Recommended Rank | Alpha | VRAM (4-bit) |
|---|---|---|---|
| 7B | 16–32 | 32–64 | 8–12 GB |
| 13B | 16 | 32 | 14–18 GB |
| 70B | 8–16 | 16–32 | 40–48 GB |
Supported Dataset Formats
- Alpaca:
{"instruction": "...", "input": "...", "output": "..."} - ShareGPT:
{"conversations": [{"from": "human", "value": "..."}, ...]} - OpenAI Chat:
{"messages": [{"role": "user", "content": "..."}, ...]}
Requirements
- Python 3.8+
- Optional:
pip install transformers peft trl datasetsfor script execution
Feedback
https://bytesagain.com/feedback/ Powered by BytesAgain | bytesagain.com
- 确保已安装 OpenClaw(本地或 Docker 部署)
- 在对话框中输入安装命令:
/install bytesagain-lora-toolkit - 安装完成后,直接呼叫该 Skill 的名称或使用
/bytesagain-lora-toolkit触发 - 根据 Skill 的参数说明提供必要输入,即可获得结构化输出
LoRA Toolkit 是什么?
Configure, estimate, and generate LoRA fine-tuning scripts for LLMs. Input: base model name, dataset size, GPU spec. Output: training config, PEFT script, co... 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件,目前累计下载 82 次。
如何安装 LoRA Toolkit?
在 OpenClaw 或 Claude Code 对话框中运行命令「/install bytesagain-lora-toolkit」即可一键安装,无需额外配置。
LoRA Toolkit 是免费的吗?
是的,LoRA Toolkit 完全免费,采用 MIT-0 许可证,可自由下载、安装和使用。
LoRA Toolkit 支持哪些平台?
LoRA Toolkit 跨平台运行,可在任意部署了 OpenClaw / Claude Code 的环境中使用(cross-platform)。
谁开发了 LoRA Toolkit?
由 loutai0307-prog(@loutai0307-prog)开发并维护,当前版本 v1.0.0。