Helios
Our model-compression format. Helios reaches Q4_K_M-class quality at a little over half the file size, is lossless and deterministic on every run, and holds across model families. It has grown from a single format into a family of compression systems under one umbrella.
Available for licensingView the benchmarks