Applied Safety Research Engineer, Safeguards
仕事内容
Design and run experiments to improve evaluation quality, including methods to generate representative test data, simulate realistic user behavior, and validate grading accuracy.
Research how factors such as multi-turn conversations, tools, long context, and user diversity impact model safety behavior.
Analyze evaluation coverage to identify gaps and determine where better measurement is needed.
Productionize successful research into evaluation pipelines that run during model training, launch, and beyond.
Collaborate with Policy and Enforcement to translate real-world harm patterns into measurable evaluations.
Build tooling that enables policy experts to create and iterate on evaluations, and surface findings to drive upstream model improvements.
Research how factors such as multi-turn conversations, tools, long context, and user diversity impact model safety behavior.
Analyze evaluation coverage to identify gaps and determine where better measurement is needed.
Productionize successful research into evaluation pipelines that run during model training, launch, and beyond.
Collaborate with Policy and Enforcement to translate real-world harm patterns into measurable evaluations.
Build tooling that enables policy experts to create and iterate on evaluations, and surface findings to drive upstream model improvements.
求人の全文を見る
業務内容、求める人物像、スキル、待遇 — 無料アカウントの作成で閲覧できます。
または
すでにアカウントをお持ちですか?
ログイン類似の求人
あなたに合いそうな他の職種。
リモートワークPartial
勤務地San Francisco, アメリカ合衆国