Quantization
What does Quantization mean?
Representing model values with lower precision to reduce memory or computation, sometimes at an accuracy cost.
A practical example
A model is converted to lower-bit weights to fit a smaller device.
MICHAEL ORACLE’S AI DICTIONARY
Training & models · Advanced