Topic
Lora
Learn Lora as a connected topic across chapters, concepts, simulations, and interview reasoning.
10 Concepts5 Articles1h 44m
Overview
Learn Lora as a connected topic across chapters, concepts, simulations, and interview reasoning.
How this topic helps
Fine Tuning
Llm
Ai
Deep Learning
Learning Path in this Topic
Series that contain articles from Lora. Select a path to filter the article list.
Articles
5 matched articles
Article 1Fine-Tuning LLMs: The Complete Engineer's Guide to SFT, LoRA, and RLHFTLDR: A pretrained LLM is a generalist. Fine-tuning makes it a specialist. Supervised Fine-Tuning (SFT) teaches it your domain's language through labeled examples. LoRA does the same with 99% fewer tr30 min
Article 2PEFT, LoRA, and QLoRA: A Practical Guide to Efficient LLM Fine-TuningTLDR: Full fine-tuning updates every model weight, which is expensive in memory, compute, and storage. PEFT methods update only a small trainable slice. LoRA learns low-rank adapters on top of frozen 14 min
Article 3LoRA Explained: How to Fine-Tune LLMs on a BudgetTLDR: Fine-tuning a 7B-parameter LLM updates billions of weights and requires expensive GPUs. LoRA (Low-Rank Adaptation) freezes the original weights and trains only tiny adapter matrices that are add13 minArticle 4Fine-Tuning LLMs with LoRA and QLoRA: A Practical Deep-DiveTLDR: LoRA freezes the base model and trains two tiny matrices per layer — 0.1 % of parameters, 70 % less GPU memory, near-identical quality. QLoRA adds 4-bit NF4 quantization of the frozen base, enab31 minArticle 5BFS — Breadth-First Search: Level-by-Level Graph ExplorationTLDR: BFS explores a graph level by level using a FIFO queue, guaranteeing the shortest path in unweighted graphs. Recognize BFS problems by keywords: "shortest path," "minimum steps," or "level order16 min