Inference · compare

FunctionGemma 270M vs Sarvam-1.

Side by side only on machines of the same kind, so the difference is the model, not the computer. Each figure is the fastest build of that model on that machine.

3machine kinds both ran on
MachineFunctionGemma 270M tok/sSarvam-1 tok/sContext A / B
Linux, 4 CPUs · 31 GB40IQ4_NL (4-bit) by Mungert111Q4_K_M (4-bit) by bartowski— / 4K
L4 · 23 GB341Q4_K_M (4-bit) by unsloth121Q4_K_M (4-bit) by bartowski— / 8K
Intel(R) Iris(R) Xe Graphics · 1 GB67IQ2_XXS (2-bit) by unsloth4.8Q4_K_M (4-bit) by bartowski— / 4K