Lead Data Engineer – Hadoop – Spark – Python
Is this job for you?
Build my CV Build your CV and see how well you match this role — and every other one.
Track your applications on mobile The free Whileresume app, on iPhone and Android.
The role
Lead data engineering consultant responsible for designing, building, and scaling data platforms using Hadoop, Spark, and Splunk.
Hands-on Python development to process raw, structured, semi-structured, and unstructured data (SQL and NoSQL).
Architect and optimize end-to-end ETL/ELT pipelines, enabling large-scale data integration and quality assurance.
Implement CI/CD pipelines, maintain version control, and drive automated testing; collaborate with BI/Analytics teams and pair program.
Promote agile practices and SRE principles, contributing to standups, problem-solving sessions, and resilience improvements.
Contract-based role in Sheffield with partial office presence (3 days/week) starting 02/03/2026; contract runs through November.
Hands-on Python development to process raw, structured, semi-structured, and unstructured data (SQL and NoSQL).
Architect and optimize end-to-end ETL/ELT pipelines, enabling large-scale data integration and quality assurance.
Implement CI/CD pipelines, maintain version control, and drive automated testing; collaborate with BI/Analytics teams and pair program.
Promote agile practices and SRE principles, contributing to standups, problem-solving sessions, and resilience improvements.
Contract-based role in Sheffield with partial office presence (3 days/week) starting 02/03/2026; contract runs through November.
See the full job post
Responsibilities, requirements, skills and benefits — create your free account.
or
Already have an account?
Log inYou might also like these jobs
No closely matching jobs yet — here are the most recent ones.