Tag: peft
All the articles with the tag "peft".
Fine-tuning LLMs with LoRA: A Practical Guide
Published: at 10:00 AMA practical guide to fine-tuning Large Language Models with LoRA (Low-Rank Adaptation). Learn how parameter-efficient fine-tuning works, why it dramatically reduces compute and memory, and how to implement it end-to-end using Hugging Face PEFT and Transformers, including QLoRA for consumer GPUs.