How Do You Fit a 700B Model into 8GB VRAM? A Look at Quantization and Distillation

700G 的大模型怎么塞进 8G 显存？聊聊量化和蒸馏

A public trend signal observed across 1 source.