AI Architecture & Systems

SFT and Parameter-Efficient Fine-Tuning

6.13.1Instruction Tuning and Conversational Supervision#

6.13.2Full Fine-Tuning and Partial Parameter Updates#

6.13.3Adapter, Prefix Tuning, and Prompt Tuning#

6.13.4LoRA, QLoRA, DoRA, and Low-Rank Adaptation#

6.13.5Multi-Task/Multi-Domain Fine-Tuning#

6.13.6Adapter Merging, Model Merging, and Transfer#