Inference · compare

Gemma 3 270M vs MiniCPM5 1B.

Side by side only on machines of the same kind, so the difference is the model, not the computer. Each figure is the fastest build of that model on that machine.

4machine kinds both ran on
MachineGemma 3 270M tok/sMiniCPM5 1B tok/sContext A / B
L4 · 23 GB292Q4_K_M (4-bit) by unsloth208Q4_K_M (4-bit) by openbmb— / 64K
Intel(R) Iris(R) Xe Graphics · 1 GB69IQ2_M (2-bit) by unsloth21Q4_K_M (4-bit) by openbmb— / 4K
GeForce RTX 3080 Ti · 12 GB286Q4_K_M (4-bit) by unsloth381Q4_K_M (4-bit) by openbmb— / 4K
Windows, 8 CPUs · 16 GB52Q4_K_M (4-bit) by unsloth22Q4_K_M (4-bit) by openbmb— / 8K