Senior Research Engineer, LLM Evaluation and Behavioral Analysis
Is deze vacature iets voor u?
Mijn cv maken Maak uw cv en ontdek uw matchpercentage met deze functie — en met alle andere.
Volg uw sollicitaties op mobiel De gratis Whileresume-app, op iPhone en Android.
De functie
Build and iterate evaluation frameworks across instruction following, function calling, long-context reasoning, multi-turn dialog, safety, and agentic behaviors.
Develop specialized evaluation suites for function calling, including argument correctness, schema adherence, tool selection, planning, and error recovery.
Design agentic workflows: task decomposition, multi-step planning, self-correction, and autonomous tool-use sequences.
Create CI/CD pipelines for A/B comparisons, regression detection, behavioral drift monitoring, and adversarial probing.
Curate high-quality evaluation datasets with nuanced, challenging cases spanning domains.
Collaborate with researchers and engineers to diagnose failures, triage regressions, and build dashboards that visualize behavior changes across releases.
Develop specialized evaluation suites for function calling, including argument correctness, schema adherence, tool selection, planning, and error recovery.
Design agentic workflows: task decomposition, multi-step planning, self-correction, and autonomous tool-use sequences.
Create CI/CD pipelines for A/B comparisons, regression detection, behavioral drift monitoring, and adversarial probing.
Curate high-quality evaluation datasets with nuanced, challenging cases spanning domains.
Collaborate with researchers and engineers to diagnose failures, triage regressions, and build dashboards that visualize behavior changes across releases.
Bekijk de volledige vacature
Taken, profiel, vaardigheden en voordelen — maak gratis een account aan.
of
Al een account?
InloggenDeze vacatures zijn misschien iets voor u
Nog geen echt vergelijkbare vacatures — hier zijn de nieuwste.