Inference · compare

Airavata 7B (Hindi) vs FunctionGemma 270M.

Side by side only on machines of the same kind, so the difference is the model, not the computer. Each figure is the fastest build of that model on that machine.

1machine kind both ran on
MachineAiravata 7B (Hindi) tok/sFunctionGemma 270M tok/sContext A / B
Linux, 4 CPUs · 31 GB32Q4_K_M (4-bit) by mradermacher40IQ4_NL (4-bit) by Mungert4K / —