Topic
Nf4
Learn Nf4 as a connected topic across chapters, concepts, simulations, and interview reasoning.
10 Concepts4 Articles1h 18m
Overview
Learn Nf4 as a connected topic across chapters, concepts, simulations, and interview reasoning.
How this topic helps
Llm
Ai
Quantization
Deep Learning
Learning Path in this Topic
Series that contain articles from Nf4. Select a path to filter the article list.
Articles
4 matched articles
Article 1GPTQ vs AWQ vs NF4: Choosing the Right LLM Quantization PipelineTLDR: GPTQ, AWQ, and NF4 all shrink LLMs, but they optimize different constraints. GPTQ focuses on post-training reconstruction error, AWQ protects salient weights for better quality at low bits, and 15 minArticle 2Fine-Tuning LLMs with LoRA and QLoRA: A Practical Deep-DiveTLDR: LoRA freezes the base model and trains two tiny matrices per layer — 0.1 % of parameters, 70 % less GPU memory, near-identical quality. QLoRA adds 4-bit NF4 quantization of the frozen base, enab31 min
Article 3Types of LLM Quantization: By Timing, Scope, and MappingTLDR: There is no single "best" LLM quantization. You classify and choose quantization along three axes: when you quantize (timing), what you quantize (scope), and how values are encoded (mapping). In17 minArticle 4Practical LLM Quantization in Colab: A Hugging Face WalkthroughTLDR: This is a practical, notebook-style quantization guide for Google Colab and Hugging Face. You will quantize real models, run inference, compare memory/latency, and learn when to use 4-bit NF4 vs15 min