Senior Software Engineer (MLOps) – Serving
Is deze vacature iets voor u?
Mijn cv maken Maak uw cv en ontdek uw matchpercentage met deze functie — en met alle andere.
Volg uw sollicitaties op mobiel De gratis Whileresume-app, op iPhone en Android.
De functie
Architect and build scalable ML/LLM model-serving systems across data centers with strong SLAs, observability, and reliability.
Design and optimize Ray-based inference infrastructure to handle both low- and high-throughput workloads.
Enable applied scientists to deploy and test models via self-service tools, CI/CD pipelines, and rollback mechanisms.
Implement A/B testing and shadow deployment capabilities to evaluate new model versions in production.
Collaborate with platform teams to improve GPU provisioning, traffic routing, and runtime performance.
Instrument inference workflows with telemetry (latency, token counts, errors) to drive performance and safety analysis.
Design and optimize Ray-based inference infrastructure to handle both low- and high-throughput workloads.
Enable applied scientists to deploy and test models via self-service tools, CI/CD pipelines, and rollback mechanisms.
Implement A/B testing and shadow deployment capabilities to evaluate new model versions in production.
Collaborate with platform teams to improve GPU provisioning, traffic routing, and runtime performance.
Instrument inference workflows with telemetry (latency, token counts, errors) to drive performance and safety analysis.
Bekijk de volledige vacature
Taken, profiel, vaardigheden en voordelen — maak gratis een account aan.
of
Al een account?
InloggenDeze vacatures zijn misschien iets voor u
Nog geen echt vergelijkbare vacatures — hier zijn de nieuwste.