Hugging Face's training stack for supervised fine-tuning and preference tuning. Built by Hugging Face.
Others in fine-tuning
Common questions
Is Transformers and TRL free to use?
Transformers and TRL is open source and free to run yourself. You still pay whichever model provider you point it at, and this tutorial is free with no signup.
Do I need to know Python to use Transformers and TRL?
Basic Python is enough. Functions, dictionaries and imports cover most of what Transformers and TRL asks of you.
When should I not use Transformers and TRL?
When something else in fine-tuning fits the job better. The others in that group are listed below.
Lessons for Transformers and TRL are being written. Meanwhile the APIs for AI tutorial covers the same ground: state, tools, loops, memory and human approval. Most of it carries straight over.
Start the APIs for AI tutorial →