Quantization
All articles
4 total
Microscaling (MX) Formats New
A family of block-scaled low-precision numeric formats standardized by …
Glossary
Added 6 Jul
·
Upd 6 Jul
·2 min
LoRA and QLoRA New
Low-Rank Adaptation freezes a model and trains a small pair of low-rank …
Glossary
Added 1 Jul
·
Upd 1 Jul
·7 min
Small Language Models vs Large Language Models New
How to choose between a small on-device model and a large general model …
Comparisons
Added 23 Jun
·
Upd 23 Jun
·8 min
Quantization
How INT8 and INT4 quantization compress neural network models for faster …
Glossary
Added 28 Mar
·
Upd 30 May
·3 min
Open source projects