Hey everyone who's been waiting for Apple Silicon training support!
I've been building pmetal — a native Apple Silicon ML training & inference toolkit written in Rust on top of Metal/MLX. It features:
- Fine-tuning (LoRA/QLoRA) directly on Apple Silicon with Metal GPU acceleration
- Distillation & GRPO training loops
- Model merging (SLERP, TIES, DARE, DELLA, and more)
- Inference with ANE (Apple Neural Engine) support
- Hybrid architecture support including GDN, MoE, and Mamba-style models
- Support for Llama, Qwen, Gemma, Phi, DeepSeek, Mistral, Cohere, and others
- TUI dashboard for monitoring training runs
If you've got an M-series Mac and have been wanting to train locally without jumping through hoops, give it a look. Feedback and contributions welcome!
You may be wondering why I'm making this issue - I made a friendly post on r/unsloth and in the unslothai/unsloth#4 but the unsloth maintainers have deleted and shadow banned me because they are afraid of the competition. It has given me the energy to push back in any way that I can.
cc: @nicosuave @ChristianWeyer @mbtre @vlbosch @CyborgArmy83 @WiseFarAI @kevin801221 @mobguang @sealad886 @daniel-luper @MalikRumi @abeppu @cj-wilson @AlbertMarashi
@YannPourcenouxOneflow @yiranleng @AbdulwahabDev @Lu-Junwen @ferserc1 @yukiarimo @zachmayer @hg0428 @ivanfioravanti @saattrupdan @unizhu @karthikodes @ehartford @anishjain123
@chimezie @dennisnoto-etana @maxlim0 @werty1st @miguel-siqueira-reis @gmolinart @tyoc213 @DiaaNoon @liwd190019 @alanyoungcy @Vricken @MoYJiang @avvrossini @wyek1n @diegorv @kkolago
@yongpro @Thireus @giraffeTreePruner @voxmenthe @jrocco2 @shuhongwu
Hey everyone who's been waiting for Apple Silicon training support!
I've been building pmetal — a native Apple Silicon ML training & inference toolkit written in Rust on top of Metal/MLX. It features:
If you've got an M-series Mac and have been wanting to train locally without jumping through hoops, give it a look. Feedback and contributions welcome!
You may be wondering why I'm making this issue - I made a friendly post on r/unsloth and in the unslothai/unsloth#4 but the unsloth maintainers have deleted and shadow banned me because they are afraid of the competition. It has given me the energy to push back in any way that I can.
cc: @nicosuave @ChristianWeyer @mbtre @vlbosch @CyborgArmy83 @WiseFarAI @kevin801221 @mobguang @sealad886 @daniel-luper @MalikRumi @abeppu @cj-wilson @AlbertMarashi
@YannPourcenouxOneflow @yiranleng @AbdulwahabDev @Lu-Junwen @ferserc1 @yukiarimo @zachmayer @hg0428 @ivanfioravanti @saattrupdan @unizhu @karthikodes @ehartford @anishjain123
@chimezie @dennisnoto-etana @maxlim0 @werty1st @miguel-siqueira-reis @gmolinart @tyoc213 @DiaaNoon @liwd190019 @alanyoungcy @Vricken @MoYJiang @avvrossini @wyek1n @diegorv @kkolago
@yongpro @Thireus @giraffeTreePruner @voxmenthe @jrocco2 @shuhongwu