LLM Systems 21: Parameter Efficient Fine-Tuning for LLM
0. Recap
Direct quantization for low-bit numbers
absmax: linearly scale according to max abs value
zero-point: finding zero-point and scale
Layer-wise quantization approaches
AdaQuant / K