Research Engineer / Research Scientist, Pre-training

In this hybrid role, you will conduct research and implement solutions across model architecture, algorithms, data processing, and optimizer development.
Independently lead small research projects while collaborating with teammates on larger initiatives.
Design, run, and analyze scientific experiments to advance understanding of large language models.
Optimize and scale our training infrastructure to improve efficiency and reliability.
Develop and improve dev tooling to enhance team productivity.
Contribute to the entire stack, from low-level optimizations to high-level model design, with a BA in CS/ML and strong Python and DL framework skills.