Abliterated GGUF distill. No quoted tok/s.
Params
35B / 3B act
Fastest decode
—
Refusal
Abliterated
Setups
0
Runs on
Quoted one-stream decode on real boxes.
No quoted pair yet.
Get it running
- 1. DownloadPuts the weights on this computer.
huggingface-cli download IsValorum/Qwen3.8-35B-A3B-Distill-MTP-APEX-I-MiniPlus-V2.1-Abliterated-GGUF - 2. Start itUse this only if the download is GGUF.
llama-server -hf IsValorum/Qwen3.8-35B-A3B-Distill-MTP-APEX-I-MiniPlus-V2.1-Abliterated-GGUF - Open the weightsHugging Face ↗