AI Evaluation Engineer

Is deze vacature iets voor u?

Maak uw cv en ontdek uw matchpercentage met deze functie — en met alle andere.

Volg uw sollicitaties op mobiel De gratis Whileresume-app, op iPhone en Android.

Downloaden in de App Store Verkrijgbaar via Google Play

De functie

Mindrift seeks an AI Evaluation Engineer with over five years in software development to create and refine tasks for evaluating AI coding agents in real-world scenarios. The role involves designing developer environments, crafting tasks, and writing tests that assess AI solutions, ensuring they handle multiple valid approaches. Candidates should have experience with Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, and Redis, along with functional and integration testing abilities. The position requires English proficiency at B2+ level and offers a project-based structure with flexible scheduling. Responsibilities include reviewing AI agent solutions, analysing failures, and improving evaluation frameworks without developing code from scratch. The work environment is specifically geared towards testing frontier models' capabilities and limitations.

Bekijk de volledige vacature

Taken, profiel, vaardigheden en voordelen — maak gratis een account aan.

Al een account?

Inloggen

Deze vacatures zijn misschien iets voor u

Nog geen echt vergelijkbare vacatures — hier zijn de nieuwste.

? Mechanical Manager – Southampton Southampton ? Compliance Consultant – Southampton Southampton ? Site Construction Manager – Energy & Utilities Infrastructure Southampton ? Freelance Construction Manager – Southampton Southampton ? Technical Consultant – Southampton Southampton ? Associate Project Manager – Southampton Southampton