トップ
おなかすいた族!
implements the AWQ? algorithm for 4-bit quantization with a 2x speedup during inference.
https://github.com/casper-hansen/AutoAWQ