Decode · tok/s
92
Prefill
2850
tok/100W
20.4
They report 87-98 tok/s decode on short prompts, and 2,850 tok/s prompt with 92 tok/s decode on a 136K needle test that it passed.
Second-hand report of a Redditor. Rank uses the specific quoted 92 tok/s on the 136K needle. 87-98 short-prompt range skipped. 64GB DDR5, 40GiB experts in RAM, no disk reads. Strata 0.1.45, STRATA_ROUTE_TAIL_SKIP=0.
