Senior Research Engineer, LLM Evaluation and Behavioral Analysis
Is this job for you?
Build my CV Build your CV and see how well you match this role — and every other one.
Track your applications on mobile The free Whileresume app, on iPhone and Android.
The role
Build and iterate evaluation frameworks across instruction following, function calling, long-context reasoning, multi-turn dialog, safety, and agentic behaviors.
Develop specialized evaluation suites for function calling, including argument correctness, schema adherence, tool selection, planning, and error recovery.
Design agentic workflows: task decomposition, multi-step planning, self-correction, and autonomous tool-use sequences.
Create CI/CD pipelines for A/B comparisons, regression detection, behavioral drift monitoring, and adversarial probing.
Curate high-quality evaluation datasets with nuanced, challenging cases spanning domains.
Collaborate with researchers and engineers to diagnose failures, triage regressions, and build dashboards that visualize behavior changes across releases.
Develop specialized evaluation suites for function calling, including argument correctness, schema adherence, tool selection, planning, and error recovery.
Design agentic workflows: task decomposition, multi-step planning, self-correction, and autonomous tool-use sequences.
Create CI/CD pipelines for A/B comparisons, regression detection, behavioral drift monitoring, and adversarial probing.
Curate high-quality evaluation datasets with nuanced, challenging cases spanning domains.
Collaborate with researchers and engineers to diagnose failures, triage regressions, and build dashboards that visualize behavior changes across releases.
See the full job post
Responsibilities, requirements, skills and benefits — create your free account.
or
Already have an account?
Log inYou might also like these jobs
No closely matching jobs yet — here are the most recent ones.