Inference · hardware

What runs on Windows, 16 CPUs · 16 GB.

Every open model a machine of this kind has run on the network, at its fastest build, fastest first. Speed is tokens a second, measured and signed by the machine itself.

5models measured
225fastest tok/s
1machine