For most GPU inference deployments, FP8 weight-and-activation quantization is the default pick on Hopper or newer hardware: each weight is stored in one byte instead of two, roughly halving weight memory against BF16 while the quality impact is usually small enough to verify with an afternoon of evaluation. INT8 W8A8 …