Every open model a machine of this kind has run on the network, at its fastest build, fastest first. Speed is tokens a second, measured and signed by the machine itself.
| Model | Fastest build here | tok/s | Context | $ / M tokens |
|---|---|---|---|---|
| Gemma 3 270M | IQ2_M (2-bit) by unsloth | 69 | — | $1.03 |
| FunctionGemma 270M | IQ2_XXS (2-bit) by unsloth | 67 | — | $1.07 |
| MiniCPM-V 4.6 Base | Q4_K_M (4-bit) by openbmb | 27 | 4K | $2.62 |
| MiniCPM5 1B | Q4_K_M (4-bit) by openbmb | 21 | 4K | $3.48 |
| GLM-OCR Base | Q3_K_S (3-bit) by mradermacher | 18 | 4K | $3.94 |
| DeepSeek-OCR 2 Base | Q4_K_M (4-bit) by sabafallah | 15 | — | $4.72 |
| Hunyuan MT 2 1.8B | Q3_K_S (3-bit) by mradermacher | 15 | — | $4.68 |
| DeepSeek-OCR Base | Q4_K_M (4-bit) by sabafallah | 13 | — | $5.44 |
| Hunyuan MT 1.5 1.8B | Q4_K_M (4-bit) by tencent | 7.4 | — | $9.70 |
| Sarvam-1 | Q4_K_M (4-bit) by bartowski | 4.8 | 4K | $14.95 |
| Ministral 3 3B-Instruct-2512 | Q4_K_M (4-bit) by mistralai | 4.7 | 4K | $15.60 |
| MiniCPM-V 4 Base | Q4_K_M (4-bit) by openbmb | 3.2 | — | $22.62 |