Machine Learning Engineer - Pre-Training

Profile and optimize large-scale GPU training workflows to identify bottlenecks using tools like NVIDIA Nsight Systems. Design and implement efficiency improvements to maximize MFU through tensor parallelism, model compilation, and mixed precision. Build observability tooling to monitor performance metrics and enable data-driven optimization. Collaborate closely with Research teams to integrate training enhancements into scalable workflows. Drive a culture of performance optimization across the training platform, improving throughput and model scale. Contribute to developing robust, well-tested Python code and maintain high technical standards.