hf.co/Qwen/Qwen2.5-0.5B-Instruct-GGUF:Q4_K_M
Qwen · Q4_K_M · on ollama · vendor build
Measured by 6 nodes on hardware we do not own, and signed by each of them. What machines here actually proved — never what the card claims.
matrix built 30 Oct 2026 · every field verified against the signature of the node that produced it, and re-verifiable by you: each signed figure carries the exact bytes the node signed (signing_payload_b64) and the signature over them, and the ed25519 public key is embedded in node_did. effective_ctx is the context length a node PROVED by recall, never the length a model card advertisesThis model calls tools correctly and does not stop. A node watched it call the probe tool, then call it again, until the turn budget ran out. Chosen on “supports tools” alone, it will call a tool in production and never come back.
Each question was put entirely in its own language and script, and the answer had to be right. A model with no coverage cannot parse the question, so answering in English is a failure here, not a pass. 2 proved of 10 asked — a language absent from the probe set was never asked, and is not a claim either way.
How far back it remembers, machine by machine
Filled: the needle came back at that prompt size · outlined: asked and lost · blank: not asked · trained for 32K. 1 walk ended because the model forgot, 1 because the machine could not hold the prompt.
| machine · build | 4K | 8K | 16K | 32K | 64K | 128K | why it stopped |
|---|---|---|---|---|---|---|---|
| Amit KhetanTesla T4 · Q4_K_M by Qwen | 32K recalled at every size asked | ||||||
| Keshav AgarwalIntel(R) Iris(R) Xe Graphics · Q4_K_M by Qwen | 16K an older probe: where it stopped was not recorded | ||||||
| Amit KhetanIntel(R) UHD Graphics 730 · Q4_K_M by Qwen | 8K the model lost the needle at 16K | ||||||
| Amit Khetan2× Tesla T4 · Q4_K_M by Qwen | 4K too slow to answer here at 8K | ||||||
| Kunal HindochaNVIDIA GeForce RTX 3080 Ti · Q4_K_M by Qwen | — an older probe: where it stopped was not recorded | ||||||
| Gram ·9a1db0Windows, CPU only · 12 CPUs · Q4_K_M by Qwen | — an older probe: where it stopped was not recorded |
Carbon per million tokens
Lowest build on each machine · 1 of 3 read off a power sensor, the rest modelled from the parts · fewer grams is better
Carbon is location-based: signed energy × the yearly average of the grid where the machine signed its place (United States grid average · world grid average (Singapore not in the table) · India grid average; Ember Global Electricity Review 2025 (2024 generation), location-based). Facility overhead is not included. A machine on its own solar is not credited until it can prove it.
Tell us the workload, whose machines it should run on, and which jurisdiction it answers to.