Lead Data Engineer – Hadoop – Spark – Python

Lead data engineering consultant responsible for designing, building, and scaling data platforms using Hadoop, Spark, and Splunk. Hands-on Python development to process raw, structured, semi-structured, and unstructured data (SQL and NoSQL). Architect and optimize end-to-end ETL/ELT pipelines, enabling large-scale data integration and quality assurance. Implement CI/CD pipelines, maintain version control, and drive automated testing; collaborate with BI/Analytics teams and pair program. Promote agile practices and SRE principles, contributing to standups, problem-solving sessions, and resilience improvements. Contract-based role in Sheffield with partial office presence (3 days/week) starting 02/03/2026; contract runs through November.

Find here the full details of the responsibilities for this role: daily tasks, projects to lead, goals to achieve and scope of work within the team. Everything you need to picture yourself in the role and know exactly what to expect from day one.

Access the technical and interpersonal skills expected by the recruiter, the required experience level, valued qualifications and personal qualities sought. Check at a glance whether your profile matches this opportunity before applying.

Discover what the company offers its employees: remote work policy, health coverage, bonuses, continuous training, work environment and growth opportunities. All the information you need to compare this offer with your expectations and make the right choice.