Lead Data Engineer – Hadoop – Spark – Python
Is this job for you?
Build my CV Build your CV and see how well you match this role — and every other one.
The role
Lead data engineering consultant responsible for designing, building, and scaling data platforms using Hadoop, Spark, and Splunk.
Hands-on Python development to process raw, structured, semi-structured, and unstructured data (SQL and NoSQL).
Architect and optimize end-to-end ETL/ELT pipelines, enabling large-scale data integration and quality assurance.
Implement CI/CD pipelines, maintain version control, and drive automated testing; collaborate with BI/Analytics teams and pair program.
Promote agile practices and SRE principles, contributing to standups, problem-solving sessions, and resilience improvements.
Contract-based role in Sheffield with partial office presence (3 days/week) starting 02/03/2026; contract runs through November.
Hands-on Python development to process raw, structured, semi-structured, and unstructured data (SQL and NoSQL).
Architect and optimize end-to-end ETL/ELT pipelines, enabling large-scale data integration and quality assurance.
Implement CI/CD pipelines, maintain version control, and drive automated testing; collaborate with BI/Analytics teams and pair program.
Promote agile practices and SRE principles, contributing to standups, problem-solving sessions, and resilience improvements.
Contract-based role in Sheffield with partial office presence (3 days/week) starting 02/03/2026; contract runs through November.
See the full job post
Responsibilities, requirements, skills and benefits — create your free account.
Already have an account? Log in
Similar openings
Other roles that could suit you.