Inference · hardware · own machine

What runs on GeForce RTX 3080 Ti · 12 GB.

Every open model a machine of this kind has run on the network, at its fastest build, fastest first. Speed is tokens a second, measured and signed by the machine itself.

9models measured
412fastest tok/s
1machine