Senior Software Engineer/Data Scientist, Large Model Evaluation
Is this job for you?
Build my CV Build your CV and see how well you match this role — and every other one.
The role
You will evaluate driving ML models through novel metrics and sampling methods to quantify trajectory quality.
Use creative simulation strategies to measure driving performance of generative models and identify edge cases.
Build end-to-end data pipelines for signal discovery, labeling, feature extraction, and metric computation at scale.
Analyze data to diagnose regressions, quantify performance gaps, and provide actionable insights for model development.
Collaborate with cross-functional teams of engineers and researchers to scope, validate, and deploy evaluation tools.
Apply ML fundamentals and software engineering best practices to deliver production-ready evaluation systems.
Use creative simulation strategies to measure driving performance of generative models and identify edge cases.
Build end-to-end data pipelines for signal discovery, labeling, feature extraction, and metric computation at scale.
Analyze data to diagnose regressions, quantify performance gaps, and provide actionable insights for model development.
Collaborate with cross-functional teams of engineers and researchers to scope, validate, and deploy evaluation tools.
Apply ML fundamentals and software engineering best practices to deliver production-ready evaluation systems.
See the full job post
Responsibilities, requirements, skills and benefits — create your free account.
or
Already have an account?
Log inSimilar openings
Other roles that could suit you.