Software Engineer (Machine Learning - LLMs)
Is this job for you?
Build my CV Build your CV and see how well you match this role — and every other one.
The role
Software Engineer - LLMs focusing on practical, scalable LLM-powered conversational agents.
Hybrid role based in Boston, MA (3 days onsite); collaborate with ML researchers and product teams to ship features.
Own implementation and deployment of LLM-based models and pipelines via REST APIs and internal microservices.
Develop prompt engineering, RAG workflows, tool-use pipelines, and conversation orchestration logic.
Investigate real-time voice, streaming, and multi-modal capabilities; analyze outputs and system performance for iterative improvements.
Build datasets, ensure data quality and reproducibility; partner with ML/backend/product teams on deployment, monitoring, and scalability.
Hybrid role based in Boston, MA (3 days onsite); collaborate with ML researchers and product teams to ship features.
Own implementation and deployment of LLM-based models and pipelines via REST APIs and internal microservices.
Develop prompt engineering, RAG workflows, tool-use pipelines, and conversation orchestration logic.
Investigate real-time voice, streaming, and multi-modal capabilities; analyze outputs and system performance for iterative improvements.
Build datasets, ensure data quality and reproducibility; partner with ML/backend/product teams on deployment, monitoring, and scalability.
See the full job post
Responsibilities, requirements, skills and benefits — create your free account.
Already have an account? Log in
Similar openings
Other roles that could suit you.