Backend Engineer, AI
Is this job for you?
Build my CV Build your CV and see how well you match this role — and every other one.
The role
Build and operate production-grade backend systems that power AI-powered features.
Design inference pipelines, orchestration layers, and clear service boundaries around models.
Own production concerns including monitoring, logging, alerting, and incident response.
Optimize latency and throughput across inference, caching, batching, and streaming.
Work with Python/Node.js, PyTorch, and multiple LLMs to ship scalable AI solutions.
Collaborate across models, APIs, and product behavior to ensure correctness and reliability.
Design inference pipelines, orchestration layers, and clear service boundaries around models.
Own production concerns including monitoring, logging, alerting, and incident response.
Optimize latency and throughput across inference, caching, batching, and streaming.
Work with Python/Node.js, PyTorch, and multiple LLMs to ship scalable AI solutions.
Collaborate across models, APIs, and product behavior to ensure correctness and reliability.
See the full job post
Responsibilities, requirements, skills and benefits — create your free account.
Already have an account? Log in
Similar openings
Other roles that could suit you.
? Backend Engineer, AI ? Backend Engineer- Data Science ? Senior Backend Engineer - Applied ML for Safety & Integrity ? Senior Backend Engineer - Distributed Systems for ML Inference ? Staff Software Engineer, Infrastructure (ML and Real-Time Speech) ? Staff Software Engineer, Listings & Host Tools and AI
Remote workno
CityNot Disclosed, CN