Machine Learning Engineer Internship, TRL - US Remote

At Hugging Face, we’re on a journey to democratize good AI. We are building the fastest growing platform for AI builders with over 5 million users & 100k organizations who collectively shared over 1M models, 300k datasets & 300k apps. Our open-source libraries have more than 400k+ stars on Github.

About the Role

In the past year the focus of building LLMs has gradually shifted from pretraining to post-training. This means spending more and more time on figuring out how to get models follow instructions reliably, use tools and generally align with certain values. With over 10k Github stars and close to 1M monthly installs the TRL library has become one of the go-to libraries for post-training. It scales flexibly from a single GPU to large clusters of GPUs using PEFT and ZeRO and offers a wide range of trainers for the latest post training techniques such as PPO or DPO and many more. In addition it includes a user friendly CLI that allows...