Inference · every season
Every model, one table.
Every model this network has run in 14 weeks of seasons: how fast it ran and on what machine, what a million tokens costs here next to what OpenRouter charges, what it proved it can do, and who its licence lets you serve.
96models measured here
82that no hosted API sells
137sold by OpenRouter
0cheaper here than OpenRouter
what a million tokens costs here
Every machine is metered at one posted price list: $0.036 a CPU-hour, $0.003 a GB of memory an hour, $0.36 a GPU-hour and $0.1 a kWh. A model's price here is that list applied to the machine its signed result names (its CPUs, memory and card) for the time it takes to write a million tokens at its signed speed.
why the API is usually cheaper
A hosted API runs one model for thousands of people on data-centre GPUs. One machine running one model for one person can't match that price. Running here pays off when the work must stay on your own machines, or when no API sells the model at all.
who you may serve
Read from each model's licence. Apache, MIT, Llama and Gemma terms let you serve anyone. Custom or community licences (Qwen's, MiniMax's): your own machines and your company's only. Non-commercial ones: your own machines, unpaid work.
91 modelsclick a column to sort by it · click a model for every machine it ran on
| parameters | tokens/sec | proved | per M tokens | per M tokens | Verdict | ||||
|---|---|---|---|---|---|---|---|---|---|
 Text & chat · by Google18 builds | 5.1B2B active | 3.8 GB | 173 NVIDIA 12 GB | 128k | 10 + 20 lang | $1.39metered | not sold | Anyone | only on this network |
Text & chat · by Google8 builds | 8B4B active | 4.6 GB | 83NVIDIA 15 GB | 128k | 10 + 14 lang | $1.73metered | not sold | Anyone | only on this network |
Text & chat · by Google5 builds | 12B | 6.6 GB | 24NVIDIA 15 GB | 256k | 10 + 14 lang | $5.79metered | not sold | Anyone | only on this network |
Text & chat · by Google3 builds | 26B4B active | 15.8 GB | 18NVIDIA 15 GB | 128k | 10 + 20 lang | $8.79metered | $0.3015 providers · free tier | Anyone | API 29× cheaper |
 Text & chat · by Google2 builds | 31B | — | 2.3NVIDIA 15 GB | 128k | 10 + 20 lang | $57metered | $0.4016 providers · free tier | Anyone | API 144× cheaper |
 Text & chat · by Qwen8 builds | 4B | 2.3 GB | 90NVIDIA 12 GB | 64k | 8 + 5 lang | $2.21metered | not sold | Anyone | only on this network |
Text & chat · by Qwen3 builds | 600M | 0.6 GB | 45machine not reported | 4k | 8 + 1 lang | — | not sold | Anyone | only on this network |
Text & chat · by yuxinlu14 builds | 12B | — | 26NVIDIA 15 GB | 128k | 8 + 13 lang | $5.21metered | not sold | Not checked | only on this network |
Text & chat · by Qwen5 builds | 4B | 7.5 GB | 12NVIDIA 15 GB | 128k | 8 + 9 lang | $12metered | not sold | Anyone | only on this network |
Text & chat · by Qwen3 builds | 14B | 8.4 GB | ran, not timed | 64k | 8 + 7 lang | — | $0.242 providers | Anyone | measured |
 Text & chat · by openai3 builds | 20B | 10.8 GB | 4.44 CPUs, no GPU· Kaggle | 4k | 7 + 9 lang | $8.95metered | $0.0911 providers | Anyone | API 99× cheaper |
 Text & chat · by moonshotai1 build | 48B3B active | 28 GB | 2.94 CPUs, no GPU | 4k | 7 + 9 lang | $18metered | not sold | Anyone | only on this network |
 Text & chat · by zai-org3 builds · 1 variant | ≈28B | 15.7 GB | 2.54 CPUs, no GPU | 4k | 7 + 8 lang | $18metered | $0.402 providers | Anyone | API 45× cheaper |
 Text & chat · by CohereLabs4 builds | ≈31B | 17.2 GB | 2.24 CPUs, no GPU | 4k | 7 + 9 lang | $20metered | not sold | Anyone | only on this network |
Text & chat · by Qwen1 build | 1.7B | — | ran, not timed | 64k | 7 + 1 lang | — | not sold | Anyone | only on this network |
Text & chat · by Qwen1 build | 8B | — | ran, not timed | 64k | 7 + 4 lang | — | not sold | Anyone | only on this network |
 Text & chat · by meta-llama16 builds · 2 variants | 3.2B | 1.9 GB | 225NVIDIA 12 GB | 128k | 6 + 8 lang | $1.14metered | $0.332 providers | Anyone | API 3.5× cheaper |
Text & chat · by Qwen3 builds | 800M | 0.5 GB | 164 CPUs, no GPU | 4k | 6 + 1 lang | $1.91metered | not sold | Anyone | only on this network |
 Text & chat · by LiquidAI1 build | 1.2B | 0.7 GB | 164 CPUs, no GPU | 4k | 6 + 1 lang | $1.95metered | not sold | You & your company | only on this network |
Text & chat · by Qwen2 builds · 1 variant | 8B | 4.7 GB | ran, not timed | 128k | 6 + 7 lang | — | $0.751 provider | Anyone | measured |
 Text & chat · by microsoft10 builds | ≈4.1B | 2.3 GB | 189NVIDIA 12 GB | 4k | 5 + 3 lang | $1.36metered | not sold | Anyone | only on this network |
Text & chat · by meta-llama11 builds | 1.2B | 0.8 GB | 20 Apple silicon | 32k | 5 + 8 lang | $2.66metered | $0.201 provider | Anyone | API 13× cheaper |
 Text & chat · by tencent2 builds · 1 variant | 30B3B active | 17 GB | 3.64 CPUs, no GPU | 4k | 5 + 10 lang | $12metered | $0.291 provider | Anyone | API 41× cheaper |
 Text & chat · by redhatai1 build | — | — | ran, not timed | 32k | 5 + 6 lang | — | not sold | Not checked | only on this network |
Text & chat · by Qwen3 builds | 500M | 0.5 GB | 239Linux · NVIDIA · 32 GB | 32k | 4 + 5 lang | $0.13metered | not sold | Anyone | only on this network |
Text & chat · by microsoft20 builds | ≈4.1B | 2.3 GB | 154NVIDIA 12 GB | 128k | 4 + 5 lang | $1.66metered | not sold | Anyone | only on this network |
Text & chat · by google13 builds · 2 variants | 270M | 0.2 GB | 404 CPUs, no GPU | — | 4 + 3 lang | $0.76metered | not sold | Anyone | only on this network |
Text & chat · by Qwen2 builds | 30B3B active | 16 GB | 27NVIDIA 15 GB | 128k | 4 + 9 lang | $5.05metered | $0.282 providers | Anyone | API 18× cheaper |
 Text & chat · by sarvamai1 build | 24B | 13.3 GB | 16NVIDIA 15 GB | 8k | 4 + 9 lang | $9.33metered | not sold | Anyone | only on this network |
 Text & chat · by krutrim-ai-labs1 build | 12B | 7 GB | 14NVIDIA 15 GB | 64k | 4 + 9 lang | $10metered | not sold | You & your company | only on this network |
 Text & chat · by ibm-granite6 builds | 1B | 1 GB | 114 CPUs, no GPU | 4k | 4 + 6 lang | $2.85metered | not sold | Anyone | only on this network |
Text & chat · by microsoft3 builds | ≈15B | 8.4 GB | 3.3Apple silicon | 32k | 4 + 9 lang | $60metered | not sold | Anyone | only on this network |
Text & chat · by google7 builds | 270M | 0.2 GB | 374 CPUs, no GPU | 32k | 3 + 2 lang | $0.82metered | not sold | Anyone | only on this network |
Text & chat · by google6 builds | 1B | 0.8 GB | 134 CPUs, no GPU | 8k | 3 + 8 lang | $2.45metered | not sold | Anyone | only on this network |
Text & chat · by sarvamai2 builds | 2B | 1.4 GB | 111NVIDIA 15 GB | 8k | 2 + 8 lang | $1.22metered | not sold | Not checked | only on this network |
 Text & chat · by mradermacher7 builds | 270M | — | 394 CPUs, no GPU | — | 2 + 3 lang | $0.79metered | not sold | Not checked | only on this network |
 Text & chat · by ai4bharat1 build | 7B | 3.9 GB | 32NVIDIA 15 GB | — | 1 + 2 lang | $4.36metered | not sold | You & your company | only on this network |
Embeddings (search) · by google13 builds | 300M | 0.2 GB | ran, not timed | — | 1 | — | not sold | Anyone | only on this network |
 Text to speech · by SWivid1 build | 150M | 0.6 GB | ran, not timed | — | 1 | — | not sold | Own machines only | only on this network |
Text to speech · by hexgrad1 build | — | 0.3 GB | ran, not timed | — | 1 + 1 lang | — | not sold | Not checked | only on this network |
 Text to speech · by facebook1 build | 40M | 0.1 GB | ran, not timed | — | 1 | — | not sold | Own machines only | only on this network |
Text to speech · by facebook1 build | 40M | 0.1 GB | ran, not timed | — | 1 | — | not sold | Own machines only | only on this network |
Text to speech · by facebook1 build | 40M | 0.1 GB | ran, not timed | — | 1 | — | not sold | Own machines only | only on this network |
Text to speech · by facebook1 build | 40M | 0.1 GB | ran, not timed | — | 1 | — | not sold | Own machines only | only on this network |
Text to speech · by facebook1 build | 40M | 0.1 GB | ran, not timed | — | 1 | — | not sold | Own machines only | only on this network |
Text to speech · by facebook1 build | 40M | 0.1 GB | ran, not timed | — | 1 | — | not sold | Own machines only | only on this network |
Text to speech · by facebook1 build | 40M | 0.1 GB | ran, not timed | — | 1 | — | not sold | Own machines only | only on this network |
Text to speech · by facebook1 build | 40M | 0.1 GB | ran, not timed | — | 1 | — | not sold | Own machines only | only on this network |
Text to speech · by facebook1 build | 40M | 0.1 GB | ran, not timed | — | 1 | — | not sold | Own machines only | only on this network |
Text to speech · by facebook1 build | 40M | 0.1 GB | ran, not timed | — | 1 | — | not sold | Own machines only | only on this network |
Text to speech · by facebook1 build | 40M | 0.1 GB | ran, not timed | — | 1 | — | not sold | Own machines only | only on this network |
Text to speech · by facebook1 build | 40M | 0.1 GB | ran, not timed | — | 1 | — | not sold | Own machines only | only on this network |
Speech to text · by UsefulSensors1 build | — | 0.2 GB | ran, not timed | — | 1 + 1 lang | — | not sold | Anyone | only on this network |
Speech to text · by UsefulSensors1 build | — | 0.1 GB | ran, not timed | — | 1 + 1 lang | — | not sold | Anyone | only on this network |
Music & sound · by facebook1 build | 1.5B | 11.1 GB | ran, not timed | — | 1 | — | not sold | Own machines only | only on this network |
Music & sound · by facebook1 build | 300M | 2.2 GB | ran, not timed | — | 1 | — | not sold | Own machines only | only on this network |
Other · by rhasspy1 build | — | — | ran, not timed | — | 1 + 1 lang | — | not sold | Not checked | only on this network |
Vision (counting, locating) · by facebook1 build | 90M | 0.7 GB | ran, not timed | — | 1 | — | not sold | Anyone | only on this network |
 Image generation · by Efficient-Large-Model1 build | 1.6B | 3 GB | ran, not timed | — | 1 | — | not sold | Anyone | only on this network |
 Image generation · by stabilityai1 build | 900M | 2.4 GB | ran, not timed | — | 1 | — | not sold | Not checked | only on this network |
 Speaker recognition · by speechbrain1 build | 20M | 0.1 GB | ran, not timed | — | 1 | — | not sold | Anyone | only on this network |
 Video generation · by Wan-AI1 build | 1.3B | 26.9 GB | ran, not timed | — | 1 | — | not sold | Anyone | only on this network |
 Image generation · by segmind1 build | 320M | 1 GB | ran, not timed | — | 1 | — | not sold | Anyone | only on this network |
Speech to text · by openai1 build | 810M | 1.5 GB | ran, not timed | — | 1 + 1 lang | — | not sold | Anyone | only on this network |
Speech to text · by openai1 build | 240M | 0.9 GB | ran, not timed | — | 1 + 6 lang | — | not sold | Anyone | only on this network |
Speech to text · by vasista221 build | 240M | 0.9 GB | ran, not timed | — | 1 + 1 lang | — | not sold | Anyone | only on this network |
Speech to text · by vasista221 build | 240M | 0.9 GB | ran, not timed | — | 1 + 1 lang | — | not sold | Anyone | only on this network |
Speech to text · by vasista221 build | 240M | 0.9 GB | ran, not timed | — | 1 + 1 lang | — | not sold | Anyone | only on this network |
Text & chat · by tencent1 build | 1.8B | 1 GB | 1322× Tesla T4 15 GB·Kaggle | — | — | $1.03metered | not sold | Not checked | only on this network |
Text & chat · by sarvamai1 build | 7B | 3.9 GB | 30NVIDIA 15 GB | — | — | $4.62metered | not sold | Anyone | only on this network |
 Text & chat · by meta-models5 builds · 1 variant | 30B | 15.6 GB | 1.3machine not reported | — | — | — | $1.202 providers | Anyone | measured |
Text & chat · by Qwen3 builds | 27B | 15 GB | 0.8machine not reported | — | — | — | $3.207 providers | Anyone | measured |
Image generation · by THUDM1 build | 5B | 20 GB | ran, not timed | — | — | — | not sold | You & your company | only on this network |
 Image generation · by THUDM2 builds | 2B | 12.8 GB | ran, not timed | — | — | — | not sold | Anyone | only on this network |
 Vision (counting, locating) · by depth-anything1 build | 100M | 0.4 GB | ran, not timed | — | — | — | not sold | Own machines only | only on this network |
Vision (counting, locating) · by depth-anything1 build | 30M | 0.1 GB | ran, not timed | — | — | — | not sold | Anyone | only on this network |
 Image generation · by tencent1 build | 13B | 39 GB | ran, not timed | — | — | — | not sold | Not checked | only on this network |
 Image generation · by Lightricks1 build | 2B | 23.6 GB | ran, not timed | — | — | — | not sold | You & your company | only on this network |
Other · by lightricks1 build | 13B | — | ran, not timed | — | — | — | not sold | Not checked | only on this network |
Translation · by google1 build | 3B | 11 GB | ran, not timed | — | 0 + 10 lang | — | not sold | Anyone | only on this network |
Translation · by facebook1 build | 1.3B | 5.1 GB | ran, not timed | — | 0 + 12 lang | — | not sold | Own machines only | only on this network |
Translation · by facebook1 build | 600M | 2.3 GB | ran, not timed | — | 0 + 12 lang | — | not sold | Own machines only | only on this network |
Other · by prunaai1 build | — | — | ran, not timed | — | — | — | not sold | Not checked | only on this network |
Other · by harahan1 build | 2B | — | ran, not timed | — | — | — | not sold | Not checked | only on this network |
Other · by lightx2v1 build | — | — | ran, not timed | — | — | — | not sold | Not checked | only on this network |
Translation · by sarvamai1 build | 4B | 8 GB | ran, not timed | — | 0 + 12 lang | — | $0.102 providers | Anyone | measured |
Other · by languaman1 build | — | — | ran, not timed | — | — | — | not sold | Not checked | only on this network |
Other · by aemotionstudio1 build | — | — | ran, not timed | — | — | — | not sold | Not checked | only on this network |
 Other · by optimum-intel-internal-testing1 build | — | — | ran, not timed | — | — | — | not sold | Not checked | only on this network |
Other · by alibaba-pai1 build | 1.3B | — | ran, not timed | — | — | — | not sold | Not checked | only on this network |
Other · by wan-ai1 build | 1.3B | — | ran, not timed | — | — | — | not sold | Not checked | only on this network |
Updated Wed, 28 Oct 2026 06:31:54 GMT. The data: table.json (models, and every build behind them), market.json (OpenRouter prices and licences, with when they were read). Back to the seasons →