Inference · compare

MiniCPM5 1B vs MiniCPM-V 4.6 Base.

Side by side only on machines of the same kind, so the difference is the model, not the computer. Each figure is the fastest build of that model on that machine.

2machine kinds both ran on
MachineMiniCPM5 1B tok/sMiniCPM-V 4.6 Base tok/sContext A / B
L4 · 23 GB208Q4_K_M (4-bit) by openbmb131Q4_K_M (4-bit) by openbmb64K / 256K
Intel(R) Iris(R) Xe Graphics · 1 GB21Q4_K_M (4-bit) by openbmb27Q4_K_M (4-bit) by openbmb4K / 4K