Staff Software Engineer/Data Scientist, Large Model Evaluation

Join a dedicated evaluation team to define novel metrics and sampling methods for driving trajectories produced by ML models. Develop simulation-based evaluation strategies to measure the driving performance of generative AI systems. Build scalable data pipelines for signal discovery, data labeling, feature extraction, and metric computation from large-scale simulations. Conduct data analysis to diagnose regressions and provide reliable performance insights that inform model development and deployment. Collaborate with engineering and research teams to translate quantitative findings into production-ready tools. Required: 7+ years of quantitative software engineering, strong Python or C++, knowledge of AI fundamentals and end-to-end model evaluation.