Senior Research Engineer, LLM Evaluation and Behavioral Analysis
仕事内容
Lead the design and iteration of evaluation frameworks that measure LLM behavior across instruction following, reasoning, tool use, and multi-turn interactions.
Develop specialized suites for function calling, including argument correctness, schema adherence, tool selection, multi-function planning, and error recovery.
Build agentic workflow evaluations that test task decomposition, multi-step planning, self-correction, and autonomous tool-use sequences.
Create CI/CD pipelines for A/B comparisons, regression detection, behavioral drift monitoring, and adversarial probing.
Curate high-quality evaluation datasets with nuanced and challenging cases across domains to guide model improvements.
Collaborate with researchers, engineers, and product teams to diagnose failures, triage regressions, and visualize behavior changes across releases.
Develop specialized suites for function calling, including argument correctness, schema adherence, tool selection, multi-function planning, and error recovery.
Build agentic workflow evaluations that test task decomposition, multi-step planning, self-correction, and autonomous tool-use sequences.
Create CI/CD pipelines for A/B comparisons, regression detection, behavioral drift monitoring, and adversarial probing.
Curate high-quality evaluation datasets with nuanced and challenging cases across domains to guide model improvements.
Collaborate with researchers, engineers, and product teams to diagnose failures, triage regressions, and visualize behavior changes across releases.
求人の全文を見る
業務内容、求める人物像、スキル、待遇 — 無料アカウントの作成で閲覧できます。
または
すでにアカウントをお持ちですか？
ログイン類似の求人
あなたに合いそうな他の職種。