Instructions to use Edge0/Edge0-35B-A3B-preview with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use Edge0/Edge0-35B-A3B-preview with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("Edge0/Edge0-35B-A3B-preview") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use Edge0/Edge0-35B-A3B-preview with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "Edge0/Edge0-35B-A3B-preview"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Edge0/Edge0-35B-A3B-preview" } ] } } }Run Pi
# Start Pi in your project directory: pi
- MLX LM
How to use Edge0/Edge0-35B-A3B-preview with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "Edge0/Edge0-35B-A3B-preview"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "Edge0/Edge0-35B-A3B-preview" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Edge0/Edge0-35B-A3B-preview", "messages": [ {"role": "user", "content": "Hello"} ] }' - Hermes Agent
How to use Edge0/Edge0-35B-A3B-preview with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "Edge0/Edge0-35B-A3B-preview"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Edge0/Edge0-35B-A3B-preview
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Edge0/Edge0-35B-A3B-preview with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "Edge0/Edge0-35B-A3B-preview"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "Edge0/Edge0-35B-A3B-preview" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Qwen 3.6 MoE 8bit base request and Roadmap past preview
Hello π€, I love your work! It's a treat for us all.
I want to ask some questions, hopefully you won't mind.
When might it go past the preview phase?
Can we have Edge0 but with Qwen 3.6 35b a3b 8bit as base?
Please please π₯Ί
One correction on our side: edge0-35b is built on Qwen3.6-35B-A3B β we had it labeled "Qwen3.5-MoE" in the README and model card by mistake. It's fixed now.
On preview: no fixed date yet, we're still working on the agentic side.
For an 8-bit 35B, honestly not in the short term. But we're building the ecosystem so new models and precisions can be adapted quickly. Tell us what you'd like and we'll see how fast we can get there.
One correction on our side: edge0-35b is built on Qwen3.6-35B-A3B β we had it labeled "Qwen3.5-MoE" in the README and model card by mistake. It's fixed now.
On preview: no fixed date yet, we're still working on the agentic side.
For an 8-bit 35B, honestly not in the short term. But we're building the ecosystem so new models and precisions can be adapted quickly. Tell us what you'd like and we'll see how fast we can get there.
Qwen3.6? Myan I need to try it. I'm so hopeful I might cry π, I see the future of my device in this project, pretty sure a lot does. MoE is the future! Thanks Edge0!!!