Decode · tok/s
87
Prefill
—
tok/100W
24.9
Here is what 1 used 3090 does with it on Strata: IQ3_S: 70 tok/s, and still 66 tok/s with 261K of context IQ2_XS: 87 tok/s prompts are read at about 1,900 tok/s
First-person single 3090. Rank is the quoted 87. Prefill ~1,900 stays a note.
