Lead AI Engineer (FM Hosting, LLM Inference) – New York, NY
Is this job for you?
Build my CV Build your CV and see how well you match this role — and every other one.
Track your applications on mobile The free Whileresume app, on iPhone and Android.
The role
Partner with cross-functional teams to deliver AI-powered products that transform how teams work and how customers interact.
Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability.
Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, and PyTorch.
Invent and apply state-of-the-art LLM optimization techniques to improve performance, scalability, latency, throughput, and cost in production systems.
Contribute to the technical vision and long-term roadmap for foundational AI systems across the organization.
Ideal candidates are technically rigorous, collaborative, curious about research, able to translate complex problems into clear plans, and capable of delivering high-quality, responsible AI at scale.
Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, and observability.
Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, and PyTorch.
Invent and apply state-of-the-art LLM optimization techniques to improve performance, scalability, latency, throughput, and cost in production systems.
Contribute to the technical vision and long-term roadmap for foundational AI systems across the organization.
Ideal candidates are technically rigorous, collaborative, curious about research, able to translate complex problems into clear plans, and capable of delivering high-quality, responsible AI at scale.
See the full job post
Responsibilities, requirements, skills and benefits — create your free account.
or
Already have an account?
Log inYou might also like these jobs
No closely matching jobs yet — here are the most recent ones.