Axolotl
OSS fine-tuning framework built on HuggingFace Transformers. Supports LoRA, QLoRA, full fine-tuning, and FSDP. Config-driven — define your training run in a YAML file.
LlamaFactory
Supports full fine-tuning, LoRA, QLoRA, DPO, RLHF, and reward modeling across 100+ models. Web UI (LlamaBoard) for no-code training. The most feature-complete OSS fine-tuning framework.