Principal AI/ML System Software Engineer
Is this job for you?
Build my CV Build your CV and see how well you match this role — and every other one.
The role
Lead development, enhancement, and maintenance of the next-generation AI deployment software, focusing on productizing the software stack for the AI compute engine.
Work across the full-stack toolchain, balancing hardware-software co-design trade-offs to optimize performance, scalability, and reliability.
Develop and scale deployment infrastructure within tight development windows, collaborating with ML, compiler, and hardware teams.
Contribute to distributed, high-performance software design and implement robust tests and verifications.
Drive ML workload deployments (LLMs, VLMs, NLP) on distributed systems to accelerate time-to-value.
Demonstrate ownership, mentorship, and proactive collaboration in a hybrid, fast-paced environment.
Work across the full-stack toolchain, balancing hardware-software co-design trade-offs to optimize performance, scalability, and reliability.
Develop and scale deployment infrastructure within tight development windows, collaborating with ML, compiler, and hardware teams.
Contribute to distributed, high-performance software design and implement robust tests and verifications.
Drive ML workload deployments (LLMs, VLMs, NLP) on distributed systems to accelerate time-to-value.
Demonstrate ownership, mentorship, and proactive collaboration in a hybrid, fast-paced environment.
See the full job post
Responsibilities, requirements, skills and benefits — create your free account.
Already have an account? Log in
Similar openings
Other roles that could suit you.
? Systems Software Manager, Annapurna Labs Machine Learning Acceleration, AWS ? Senior System Software Engineer - AI Data Platform - Inference Factory Optimization ? Senior System Software Engineer - AI Data Platform - Inference Factory Optimization ? Network Engineer, Senior, Mainframe, zOS, zVM, VTAM, TCP/IP, IBM, Brocade, Encryption, Technical Support, Digital Certificates, Network Communications, 3rd Party System Software, 3270 Emulation, File Transfer, Session Managers, Level 3 Support, Matrix Env ? Senior Power System Software Engineer - C/C++, Visual Basic, Java, Python, Matlab
Remote workPartial
CitySanta Clara, USA