Decode · tok/s
258
Prefill
—
tok/100W
44.9
ExLlamaV3 + DFlash2 Code: 258 tok/s Prose: 114 tok/s Structured output: 366 tok/s
First-person RTX 5090. Rank is the quoted code 258. Prose 114 stays in the note.
Qwen3.8-27B
RTX 5090 · EXL3 · ExLlamaV3
RTX 5090 · EXL3 · ExLlamaV3
ExLlamaV3 + DFlash2 Code: 258 tok/s Prose: 114 tok/s Structured output: 366 tok/s
First-person RTX 5090. Rank is the quoted code 258. Prose 114 stays in the note.