Senior Research Engineer, LLM Evaluation and Behavioral Analysis
Questa offerta fa per te?
Crea il mio CV Crea il tuo CV e scopri la tua percentuale di corrispondenza con questa posizione — e con tutte le altre.
Segui le tue candidature da mobile L'app gratuita Whileresume, su iPhone e Android.
La posizione
Build and iterate evaluation frameworks across instruction following, function calling, long-context reasoning, multi-turn dialog, safety, and agentic behaviors.
Develop specialized evaluation suites for function calling, including argument correctness, schema adherence, tool selection, planning, and error recovery.
Design agentic workflows: task decomposition, multi-step planning, self-correction, and autonomous tool-use sequences.
Create CI/CD pipelines for A/B comparisons, regression detection, behavioral drift monitoring, and adversarial probing.
Curate high-quality evaluation datasets with nuanced, challenging cases spanning domains.
Collaborate with researchers and engineers to diagnose failures, triage regressions, and build dashboards that visualize behavior changes across releases.
Develop specialized evaluation suites for function calling, including argument correctness, schema adherence, tool selection, planning, and error recovery.
Design agentic workflows: task decomposition, multi-step planning, self-correction, and autonomous tool-use sequences.
Create CI/CD pipelines for A/B comparisons, regression detection, behavioral drift monitoring, and adversarial probing.
Curate high-quality evaluation datasets with nuanced, challenging cases spanning domains.
Collaborate with researchers and engineers to diagnose failures, triage regressions, and build dashboards that visualize behavior changes across releases.
Vedi l'annuncio completo
Mansioni, profilo, competenze e vantaggi — crea il tuo account gratuito.
o
Hai già un account?
AccediQueste offerte potrebbero interessarti
Nessuna offerta davvero simile per ora — ecco le più recenti.