family member

GLM-5_4layer

1 build of GLM-5_4layer, 1 signed run on real machines: different packagers, precisions and engines, each a different file with its own numbers.

7.7tok/s, fastest machine
9.4 GBmemory, smallest build
1provider measured it
Use it in your own room Ask Evo in your gramx and it runs on a machine that proved it. On your own machines it costs you nothing.Measure it on your machine A gram works through the catalog by itself and signs every result. 1 provider has measured GLM-5_4layer; every run is a point on the providers board.Compare every build Put it beside every other model in one table: speed, price, context and the API price, one row each.
best on ollama · 1 build

no context proved on this engine yet

7.7 tok/s peak, by mradermacher Q4_K_M

What it fits on

The smallest build needs about 9.4 GB; 10 of 17 kinds of machine on the network can hold it. Bars: each kind's memory (its card's, else RAM) · ticks: every build, at the size it held plus a fifth for the prompt.

  1. Linux, CPU only · 2 CPUs1 GB RAMnone
  2. NVIDIA GeForce RTX 3050 Laptop GPU4 GB on the cardnone
  3. NVIDIA GeForce GTX 16504 GB on the cardnone
  4. AMD Radeon(TM) Vega 8 Mobile Graphics7 GB RAMnone
  5. Windows, CPU only · 12 CPUs7 GB RAMnone
  6. Apple silicon8 GB RAMnone
  7. Apple M18 GB RAMnone
  8. NVIDIA GeForce RTX 3080 Ti12 GB on the cardevery build
  9. Tesla T415 GB on the cardevery build
  10. Intel(R) UHD Graphics 73016 GB RAMevery build
  11. Intel(R) Iris(R) Xe Graphics16 GB RAMevery build
  12. Apple M416 GB RAMevery build
  13. Apple M116 GB RAMevery build
  14. NVIDIA L422 GB on the cardevery build
  15. 2× Tesla T429 GB on the cardevery build
  16. Linux, CPU only · 4 CPUs31 GB RAMevery build
  17. NVIDIA RTX PRO 6000 Blackwell Server Edition95 GB on the cardevery build

Measured by

The people whose machines signed these numbers

Every build

Each its own file with its own page: the machines that ran it and their signatures.

buildenginewhose workmemorycontext provedbest tok/smachines
Q4_K_M by mradermacherhf.co/mradermacher/GLM-5_4layer-i1-GGUF:Q4_K_Mollamaderivative · mradermacher9.4 GB—7.71