Generative AI & LLMs
Quantization
Definition
Representing model weights or calculations with lower-precision numbers to reduce memory and computation needs.
Why it matters for your business
Can make local models practical on smaller hardware, with possible quality trade-offs.
In practice
A team tests a quantized model on a laptop and checks whether invoice extraction remains accurate.