Senior Data Scientist - Generative AI
Is this job for you?
Build my CV Build your CV and see how well you match this role — and every other one.
The role
You will design and operationalize rigorous evaluation frameworks for GenAI features (text, image, video, 3D/4D) or internal AI agents.
You will run online experiments (A/B tests) and apply causal inference to quantify lift, identify opportunities, and ensure statistical rigor.
You will define leading and lagging metrics for safety, user satisfaction, engineering productivity, and code health in collaboration with cross-functional teams.
You will build automated, reproducible evaluation tooling and AI workflows that improve rigor and efficiency across product and engineering ecosystems.
You will develop dashboards and reporting frameworks that reveal model performance and developer friction, translating insights into prioritized recommendations for leadership.
A PhD or Master’s in a quantitative field plus 5+ years of experience, strong SQL (Hive/Spark) and Python or R, and familiarity with GenAI models, safety evaluation, and the model training lifecycle are expected.
You will run online experiments (A/B tests) and apply causal inference to quantify lift, identify opportunities, and ensure statistical rigor.
You will define leading and lagging metrics for safety, user satisfaction, engineering productivity, and code health in collaboration with cross-functional teams.
You will build automated, reproducible evaluation tooling and AI workflows that improve rigor and efficiency across product and engineering ecosystems.
You will develop dashboards and reporting frameworks that reveal model performance and developer friction, translating insights into prioritized recommendations for leadership.
A PhD or Master’s in a quantitative field plus 5+ years of experience, strong SQL (Hive/Spark) and Python or R, and familiarity with GenAI models, safety evaluation, and the model training lifecycle are expected.
See the full job post
Responsibilities, requirements, skills and benefits — create your free account.
or
Already have an account?
Log inSimilar openings
Other roles that could suit you.