
Fine-tune LLMs with one YAML file on Hugging Face TRL
TRLoom turns Hugging Face TRL fine-tuning into a single YAML config. Describe your model, dataset, trainer, W&B, and optional Modal GPUs — then run one command. `pip install trloom` `trloom run config.yaml` `trloom run config.yaml --modal` Built for ML engineers and researchers who want SFT, DPO, GRPO, and more without rewriting boilerplate every experiment. Open source (Apache 2.0).
TRLoom simplifies the fine-tuning of Hugging Face TRL models by allowing users to configure their setup using a single YAML file. It is open source under the Apache 2.0 license and designed for machine learning engineers and researchers.
A source that found nothing is a measurement. A source that has not run is a gap. Neither means the launch lacks the thing.