Senior Research Engineer, LLM Evaluation and Behavioral Analysis
职位介绍
Lead the design and iteration of evaluation frameworks that measure LLM behavior across instruction following, reasoning, tool use, and multi-turn interactions.
Develop specialized suites for function calling, including argument correctness, schema adherence, tool selection, multi-function planning, and error recovery.
Build agentic workflow evaluations that test task decomposition, multi-step planning, self-correction, and autonomous tool-use sequences.
Create CI/CD pipelines for A/B comparisons, regression detection, behavioral drift monitoring, and adversarial probing.
Curate high-quality evaluation datasets with nuanced and challenging cases across domains to guide model improvements.
Collaborate with researchers, engineers, and product teams to diagnose failures, triage regressions, and visualize behavior changes across releases.
Develop specialized suites for function calling, including argument correctness, schema adherence, tool selection, multi-function planning, and error recovery.
Build agentic workflow evaluations that test task decomposition, multi-step planning, self-correction, and autonomous tool-use sequences.
Create CI/CD pipelines for A/B comparisons, regression detection, behavioral drift monitoring, and adversarial probing.
Curate high-quality evaluation datasets with nuanced and challenging cases across domains to guide model improvements.
Collaborate with researchers, engineers, and product teams to diagnose failures, triage regressions, and visualize behavior changes across releases.
查看完整职位
工作职责、任职要求、技能与福利 — 免费创建账号即可查看。
或
已有账户？
登录相似职位
其他可能适合您的职位。