Research Engineer, Model Evaluations
Is this job for you?
Build my CV Build your CV and see how well you match this role — and every other one.
The role
Design and implement evaluation methodologies that assess model capabilities across reasoning, safety, helpfulness, and harmlessness. Architect and scale the evaluation platform to adapt to rapidly advancing model capabilities. Build high-throughput evaluation pipelines that run during production training to provide real-time insights for training decisions. Analyze results to identify patterns, failure modes, and opportunities for model improvement, translating findings into actionable guidance. Collaborate with research teams to develop domain-specific evaluations and human-in-the-loop assessment approaches. Establish best practices for evaluation development, mentor teammates, and contribute to external publications and communications.
See the full job post
Responsibilities, requirements, skills and benefits — create your free account.
or
Already have an account?
Log inSimilar openings
Other roles that could suit you.