AI Evaluation Engineer

Cette offre est-elle pour vous ?

Créez votre CV et découvrez votre pourcentage de correspondance avec ce poste — et avec tous les autres.

Suivez vos candidatures sur mobile L'application Whileresume, gratuite, sur iPhone et Android.

Télécharger sur l'App Store Disponible sur Google Play

Le poste

Mindrift seeks an AI Evaluation Engineer with over five years in software development to create and refine tasks for evaluating AI coding agents in real-world scenarios. The role involves designing developer environments, crafting tasks, and writing tests that assess AI solutions, ensuring they handle multiple valid approaches. Candidates should have experience with Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, and Redis, along with functional and integration testing abilities. The position requires English proficiency at B2+ level and offers a project-based structure with flexible scheduling. Responsibilities include reviewing AI agent solutions, analysing failures, and improving evaluation frameworks without developing code from scratch. The work environment is specifically geared towards testing frontier models' capabilities and limitations.

Voir l'offre en entier

Missions, profil recherché, compétences et avantages — en créant votre compte gratuitement.

Déjà un compte ?

Se connecter

Ces offres pourraient vous intéresser

Aucune offre vraiment proche pour l'instant — voici les plus récentes.

? Senior Control Systems Engineer – SCADA & Cybersecurity Stone, United Kingdom ? Cyber Security Analyst Stewkley, United Kingdom ? CRM Marketing Executive Flintshire, United Kingdom ? Product Marketing Manager - Life Sciences Stone, United Kingdom ? Head of Marketing Frodsham, United Kingdom ? Office Administrator and Marketing Coordinator Belper, United Kingdom