Tag: NF4
-
QLoRA Explained: A 4-Bit Base, NF4, and What It Really Costs
QLoRA puts a 7B to 30B fine-tune on one card. NF4, double quantisation, paged optimizers, the throughput tax nobody mentions, and the…
-
Number Formats for Training: FP32, FP16, BF16, TF32, FP8 and NF4
bf16 vs fp16, why loss scaling exists, why mixed precision keeps an fp32 master copy, and the difference between a storage format…