Senior Machine Learning Engineer - Evaluations (Design Generation)

Lead the evaluation strategy and scalable infrastructure for design generation systems, guiding teams on appropriate methods and metrics.
Design and implement automated, scalable evaluation pipelines that score generated designs while balancing accuracy with computational cost.
Define evaluation strategies for pre-deployment validation, continuous monitoring, A/B analyses, and model comparison.
Curate robust evaluation datasets and benchmark suites representing diverse use cases, edge cases, and quality dimensions.
Integrate evaluation into CI/CD workflows by creating automated quality gates that catch regressions before production.
Collaborate across research and engineering to socialize best practices, ensure tooling adoption, and align architecture with evaluation needs.