Inference · compare

Gemma 4 E2B vs Phi 4 Mini.

Side by side only on machines of the same kind, so the difference is the model, not the computer. Each figure is the fastest build of that model on that machine.

6machine kinds both ran on
MachineGemma 4 E2B tok/sPhi 4 Mini tok/sContext A / B
Linux, 4 CPUs · 31 GB84Q4_0 (4-bit) by unsloth74Q4_K_M (4-bit) by unsloth128K / 128K
GeForce RTX 3080 Ti · 12 GB183IQ4_XS (4-bit) by unsloth205Q4_K_M (4-bit) by maziyarpanahi4K / 4K
Windows, 8 CPUs · 16 GB13Q3_K_S (3-bit) by unsloth4.4IQ2_XS (2-bit) by mungert4K / —
Mac, 10 CPUs · 16 GB58Q4_0 (4-bit) by unsloth36IQ4_XS (4-bit) by bartowski4K / 4K
Windows, 16 CPUs · 16 GB170Q4_K_M (4-bit) by google154Q2_K (2-bit) by maziyarpanahi128K / —
Mac, 4 CPUs · 8 GB2.8Q3_K_M (3-bit) by unsloth2.2Q3_K_L (3-bit) by maziyarpanahi8K / 128K