← Back to Skills Marketplace
331
Downloads
0
Stars
1
Active Installs
1
Versions
Install in OpenClaw
/install mlx-local-ai
Description
一键部署支持Apple Silicon的本地LLM与中文向量Embedding服务,含统一API网关及便捷启动管理脚本。
Usage Guidance
This package mostly does what it says (sets up a local LLM + embedding stack), but there are several red flags you should address before running:
- Unknown model mirror: install/start set HF_ENDPOINT to https://hf-mirror.com. That mirror will serve model artifacts and possibly model-level code. Treat it as untrusted until you verify its operator and content. Prefer official Hugging Face endpoints or local model files.
- Remote code execution risk: start_ai.sh launches the chat server with --trust-remote-code. When combined with an untrusted model mirror this allows arbitrary Python from the model repository to run on your machine. Only use --trust-remote-code with repositories you trust.
- Missing file: install.sh expects scripts/embedding_server.py to exist (or copies it to $HOME/embedding_server.py), but the package does not include it. That means embedding may not start as advertised; inspect or provide that server script before installing.
- Supply-chain & reproducibility: install.sh uses pip install with no pinned versions. That can install unexpected package versions. Review the pip packages (mlx, mlx-lm, sentence-transformers, etc.) and consider pinning versions or auditing them before installation.
- Persistent environment changes: SKILL.md suggests appending a source line to your ~/.zshrc and install.sh creates files under $HOME. Back up your rc files first and review config/env.example before sourcing it.
Recommended actions: review the code for mlx and mlx-lm packages, verify the identity/trustworthiness of hf-mirror.com or switch HF_ENDPOINT to a trusted source, remove --trust-remote-code or only use it for vetted model repos, supply or inspect embedding_server.py, and run the installation in an isolated environment (VM/container) if you want to test it safely.
Capability Analysis
Type: OpenClaw Skill
Name: mlx-local-ai
Version: 1.0.1
The skill bundle provides a legitimate set of scripts to deploy local LLM and embedding services on Apple Silicon using the MLX framework. It includes installation, service management, and testing scripts that operate within expected parameters, such as creating a virtual environment in `~/mlx-env` and running local servers on ports 8080 and 8081. While it uses the `--trust-remote-code` flag for the model server and a Hugging Face mirror (`hf-mirror.com`), these are standard practices for local AI deployments and do not indicate malicious intent.
Capability Assessment
Purpose & Capability
The files and scripts implement a local LLM + embedding service as described, but there are small inconsistencies: scripts expect an embedding_server.py to be copied to $HOME (scripts/embedding_server.py is not present in the package), and config/openclaw.json sets the agent primary model to an external model (baiduqianfancodingplan/...) while the skill advertises local models — this could cause unexpected network usage. Overall capability is aligned but some referenced artifacts are missing or point to external models.
Instruction Scope
Runtime instructions and scripts set HF_ENDPOINT to an unknown domain (https://hf-mirror.com) and the chat start command uses --trust-remote-code. That combination lets model loading pull and execute remote model code from the mirror, which can run arbitrary Python during load. SKILL.md and install.sh also instruct modifying shell startup (sourcing env.example into ~/.zshrc), which changes user environment persistently. The scripts otherwise only manipulate files under the user's home directory.
Install Mechanism
There is no signed/verified install package; install.sh uses pip install (no pinned versions) and relies on downloading models from an unverified HF mirror (hf-mirror.com). While no explicit wget/curl downloads of executables appear, model downloads via the mirror and pip installs are a supply-chain vector. The missing embedding_server.py referenced by install.sh is another coherence problem.
Credentials
The skill declares no required env vars, but scripts rely on HF_ENDPOINT and provide comments for optional BAIDU_API_KEY/TAVILY_API_KEY. config/env.example is written and the SKILL.md instructs appending a source line to the user's ~/.zshrc, which introduces persistent environment changes. The openclaw.json also embeds an apiKey value 'local-mlx' (local-only), and the agent default primary model points to an external model — causing the agent to potentially call remote services unrelated to the local-only claim.
Persistence & Privilege
The skill does not request elevated privileges and is not 'always' enabled. However install.sh copies start_ai.sh to ~/start_ai.sh, creates a virtual environment at $HOME/mlx-env, writes config/env.example and suggests modifying ~/.zshrc to source it — these are persistent changes to the user's home environment. Uninstall.sh offers removal steps, but model caches are left unless manually removed.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install mlx-local-ai - After installation, invoke the skill by name or use
/mlx-local-ai - Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.1
Initial release of mlx-local-ai: one-click local AI services for Apple Silicon.
- Provides local LLM (Qwen3.5-4B-OptiQ-4bit via MLX-LM) and embedding (bge-base-zh-v1.5) services
- Unified OpenClaw API gateway with OpenAI-compatible endpoints
- Simple installation, start/stop scripts, and status checking
- Clear API usage examples and troubleshooting steps
- macOS 14+, Apple Silicon, Python 3.10+ required
Metadata
Frequently Asked Questions
What is MLX Local AI?
一键部署支持Apple Silicon的本地LLM与中文向量Embedding服务,含统一API网关及便捷启动管理脚本。 It is an AI Agent Skill for Claude Code / OpenClaw, with 331 downloads so far.
How do I install MLX Local AI?
Run "/install mlx-local-ai" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is MLX Local AI free?
Yes, MLX Local AI is completely free, licensed under MIT-0. You can download, install and use it at no cost.
Which platforms does MLX Local AI support?
MLX Local AI is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created MLX Local AI?
It is built and maintained by saybanet (@saybanet); the current version is v1.0.1.
More Skills