Every open model a machine of this kind has run on the network, at its fastest build, fastest first. Speed is tokens a second, measured and signed by the machine itself.
| Model | Fastest build here | tok/s | Context | $ / M tokens |
|---|---|---|---|---|
| Gemma 3 270M | Q4_K_M (4-bit) by unsloth | 27 | — | $6.41 |
| Llama 3.2 1B | build | 5.6 | 4K | $31.16 |
| MiniCPM-V 4 Base | Q4_K_M (4-bit) by openbmb | 3.7 | — | $47.40 |