Watts
Decode ÷ named TDP. No TDP, no row. Not a composite score.
| # | Model · Build | Hardware | Decode · tok/s | tok/100W |
|---|---|---|---|---|
M4 Pro 64GB | 108.6 | 241.3 | ||
M6 mini 32GB | 61.9 | 229.3 | ||
M5 Pro 64GB | 89.9 | 224.8 | ||
M4 Pro | 85.5 | 190 | ||
M4 Pro | 82.8 | 184 | ||
M5 Max | 126.5 | 180.7 | ||
M4 Pro | 49.3 | 109.6 | ||
RTX PRO 6000 Blackwell Max-Q | 272.8 | 109.1 | ||
M4 Pro | 48.3 | 107.3 | ||
M5 Pro 64GB | 41.4 | 103.5 | ||
M5 Max 128GB | 65 | 92.9 | ||
RTX A5000 | 177.6 | 77.2 | ||
M5 Max 64GB | 51 | 72.9 | ||
RTX 5090 | 370 | 64.3 | ||
M1 Max 32GB | 37 | 61.7 | ||
RTX 5090 32GB | 351 | 61 | ||
RTX PRO 6000 Blackwell Max-Q | 151.4 | 60.6 | ||
RTX A5000 | 139.3 | 60.6 | ||
Radeon RX 9060 XT 16GB | 88 | 55 | ||
4× DGX Spark | 127 | 52.9 | ||
RTX 4090 24GB | 220 | 48.9 | ||
RTX 5090 | 258 | 44.9 | ||
4× DGX Spark | 104 | 43.3 | ||
2× DGX Spark | 103 | 42.9 | ||
DGX Spark | 102.9 | 42.9 | ||
2× RTX PRO 6000 | 238 | 39.7 | ||
2× DGX Spark | 94.4 | 39.3 | ||
2× DGX Spark | 93.6 | 39 | ||
Ryzen AI Max+ 395 128GB | 53.8 | 38.4 | ||
2x DGX Spark | 85 | 35.4 | ||
RTX 5060 Ti 16GB + RTX 3070 8GB | 127 | 34.3 | ||
RTX 5090 | 195.8 | 34.1 | ||
DGX Spark | 80 | 33.3 | ||
RTX 4060 Ti 16GB | 55 | 33.3 | ||
RTX 4060 Ti 16GB | 55 | 33.3 | ||
RTX 5090 | 191 | 33.2 | ||
DGX Spark | 79.5 | 33.1 | ||
RTX 5060 8GB | 47 | 32.4 | ||
RTX 5090 | 186 | 32.3 | ||
GTX 1660 SUPER 6GB | 40 | 32 | ||
DGX Spark | 74.8 | 31.2 | ||
RTX 5060 Ti 16GB | 54.7 | 30.4 | ||
RTX 4060 Ti | 50 | 30.3 | ||
RTX 5090 32GB | 173 | 30.1 | ||
DGX Spark | 72 | 30 | ||
RTX 3060 12GB | 50 | 29.4 | ||
RTX 3060 12GB | 50 | 29.4 | ||
RTX 3090 24GB | 100.6 | 28.7 | ||
RTX 3090 24GB | 100 | 28.6 | ||
2× RTX 5060 Ti 16GB | 99.9 | 27.8 | ||
DGX Spark | 65 | 27.1 | ||
DGX Spark | 65 | 27.1 | ||
RTX 5070 12GB | 66.7 | 26.7 | ||
4× RTX PRO 6000 | 264 | 26.4 | ||
2× DGX Spark | 60.4 | 25.2 | ||
RTX 3090 24GB | 87 | 24.9 | ||
RTX 5090 32GB | 142 | 24.7 | ||
2× DGX Spark | 58 | 24.2 | ||
2x DGX Spark | 55.6 | 23.2 | ||
Tesla V100 32GB | 57 | 22.8 | ||
DGX Spark | 54.7 | 22.8 | ||
2× RTX 3090 24GB | 158.3 | 22.6 | ||
RTX 3080 Ti 12GB | 79 | 22.6 | ||
Underdog Saluki 27B | DGX Spark | 53 | 22.1 | |
2× RTX 3090 24GB | 153.4 | 21.9 | ||
Intel Arc B570 10GB | 32.4 | 21.6 | ||
DGX Spark | 50.2 | 20.9 | ||
RTX 3090 24GB | 72 | 20.6 | ||
RTX 4090 | 92 | 20.4 | ||
RTX PRO 6000 + 2× GB10 | 120 | 20 | ||
RTX 3090 24GB | 70 | 20 | ||
RTX 5090 | 114.3 | 19.9 | ||
2× DGX Spark | 45 | 18.8 | ||
RTX 5090 32GB | 104 | 18.1 | ||
RTX 5070 Ti 16GB | 53.5 | 17.8 | ||
DGX Spark | 42.3 | 17.6 | ||
2× RTX 3090 24GB | 122.5 | 17.5 | ||
8× DGX Spark | 40 | 16.7 | ||
RTX 3080 10GB | 52.7 | 16.5 | ||
RTX 3060 12GB | 27.7 | 16.3 | ||
Mac Studio M4 Max 64GB | 11.3 | 16.2 | ||
4x DGX Spark | 38.4 | 16 | ||
RTX PRO 6000 | 92.8 | 15.5 | ||
4× DGX Spark | 35 | 14.6 | ||
RTX 5090 32GB | 80.9 | 14.1 | ||
RTX 5080 16GB | 50 | 13.9 | ||
RED-SNOW 5.3 Flash | DGX Spark | 33.0 | 13.7 | |
DGX Spark | 32.3 | 13.5 | ||
DGX Spark | 32 | 13.3 | ||
DGX Spark | 31.8 | 13.3 | ||
RTX 5060 Ti 16GB | 23 | 12.8 | ||
4x DGX Spark | 30 | 12.5 | ||
DGX Spark | 30 | 12.5 | ||
DGX Spark | 28.7 | 12 | ||
2× RTX 3060 12GB | 40 | 11.8 | ||
M5 Max 64GB | 7.8 | 11.1 | ||
RTX 5060 Ti 16GB | 19 | 10.6 | ||
RTX PRO 6000 | 57.7 | 9.6 | ||
RTX 4090 24GB | 40.7 | 9 | ||
AMD MI50 32GB | 26.8 | 8.9 | ||
2× AMD MI50 32GB | 52 | 8.7 | ||
RTX 5060 Ti 16GB | 14 | 7.8 | ||
DGX Spark | 18.6 | 7.7 | ||
RTX 5090 | 42.1 | 7.3 | ||
RTX 3090 + RTX 2070 SUPER | 34.2 | 6.8 | ||
2x DGX Spark | 15 | 6.3 | ||
4× Tesla V100 32GB | 60 | 6 | ||
Intel Arc B570 10GB | 9.0 | 6 | ||
2× DGX Station GB300 | 81.5 | 5.8 | ||
RTX 5060 Ti 16GB | 10 | 5.6 | ||
Radeon RX 9070 XT | 10 | 3.3 |










