Senior Software Engineer (MLOps) – Serving
在手机上跟进您的申请 Whileresume 免费应用，支持 iPhone 和 Android。
职位介绍
Architect and build scalable ML/LLM model-serving systems across data centers with strong SLAs, observability, and reliability.
Design and optimize Ray-based inference infrastructure to handle both low- and high-throughput workloads.
Enable applied scientists to deploy and test models via self-service tools, CI/CD pipelines, and rollback mechanisms.
Implement A/B testing and shadow deployment capabilities to evaluate new model versions in production.
Collaborate with platform teams to improve GPU provisioning, traffic routing, and runtime performance.
Instrument inference workflows with telemetry (latency, token counts, errors) to drive performance and safety analysis.
Design and optimize Ray-based inference infrastructure to handle both low- and high-throughput workloads.
Enable applied scientists to deploy and test models via self-service tools, CI/CD pipelines, and rollback mechanisms.
Implement A/B testing and shadow deployment capabilities to evaluate new model versions in production.
Collaborate with platform teams to improve GPU provisioning, traffic routing, and runtime performance.
Instrument inference workflows with telemetry (latency, token counts, errors) to drive performance and safety analysis.
查看完整职位
工作职责、任职要求、技能与福利 — 免费创建账号即可查看。
或
已有账户？
登录您可能也感兴趣的职位
暂无高度相似的职位 — 以下是最新职位。