Senior Software Engineer, ML Evaluation (Infrastructure)
Is this job for you?
Build my CV Build your CV and see how well you match this role — and every other one.
The role
This role focuses on ensuring reliability and scalability for ML evaluation in an experimentation-driven environment.
Collaborate with ML Engineers, Data Scientists, and ML Infrastructure Engineers to surface signals on model, component, and system performance.
Develop, scale, and maintain CI/CD pipelines for automating metric computation, aggregation, and monitoring.
Build data management tooling to improve reproducibility and scale analyses automatically as driving data grows.
Partner with ML and product teams to define evaluation criteria and translate them into concrete metrics and targets.
Stay current with trends in ML evaluation and tooling, and apply best practices from modern ML tech stacks (TF/JAX/Torch, Kubeflow, etc.).
Collaborate with ML Engineers, Data Scientists, and ML Infrastructure Engineers to surface signals on model, component, and system performance.
Develop, scale, and maintain CI/CD pipelines for automating metric computation, aggregation, and monitoring.
Build data management tooling to improve reproducibility and scale analyses automatically as driving data grows.
Partner with ML and product teams to define evaluation criteria and translate them into concrete metrics and targets.
Stay current with trends in ML evaluation and tooling, and apply best practices from modern ML tech stacks (TF/JAX/Torch, Kubeflow, etc.).
See the full job post
Responsibilities, requirements, skills and benefits — create your free account.
Already have an account? Log in
Similar openings
Other roles that could suit you.
Remote workpartial
CitySan Francisco, United States