Bit-Width Allocation Shrinks Model from 1.5TB to ~200GiB
A method reduced model size from 1.5TB to approximately 200GiB by treating bit-width as an allocation problem, rejecting uniform low-bit quantization.
A method reduced model size from 1.5TB to approximately 200GiB by treating bit-width as an allocation problem, rejecting uniform low-bit quantization.