Hadoop Platform Engineer

Hadoop Platform Engineer

Location: Edinburgh or London (1-2 days per week on-site)
Contract- day rate

6 Month Contract

Our UK leading banking client is undergoing a major enterprise data transformation, and we're looking for a skilled Hadoop Platform Engineer to help shape and evolve the future of our data ecosystem. If you're passionate about data engineering at scale, modernisation, and cloud migration, this is a unique opportunity to work at the heart of one of the UK's largest financial institutions.

The Role

As a Hadoop Platform Engineer, you'll play a key role in supporting, maintaining, and modernising our on‑premise HDFS-based Data Lake and associated Hadoop ecosystem components. You will also help drive the strategic migration of our Hadoop workloads to the cloud, contributing to enterprise-wide simplification and transformation initiatives.

You'll work across our data engineering community, ensuring our platforms remain robust, secure, and high‑performing as we transition to the next generation of data capabilities.

What You'll Be Doing

• Managing and maintaining large-scale Hadoop clusters across on‑prem environments
• Supporting and optimising our HDFS-based Data Lake and adjacent platform components
• Working with technologies including Hadoop, Spark, HDFS, YARN, Hive, Oozie, and related tooling
• Partnering with engineering teams to deliver scalable, high‑quality data solutions
• Contributing to our cloud migration strategy, helping move legacy workloads into modern cloud platforms
• Driving platform simplification and engineering excellence across distributed systems
• Supporting enterprise data transformation activities that enable the bank's strategic objectives
• Ensuring stability, performance, and security of critical data services

What We're Looking For

• Strong hands-on experience with Hadoop ecosystem tools (HDFS, Spark, Hive, Oozie, YARN, etc.)
• Experience operating and supporting large, complex, distributed clusters
• Understanding of data engineering principles and data platform design
• Experience with on-prem Hadoop environments and ideally cloud-based data platforms
• Exposure to cloud technologies (AWS, Azure, or GCP)
• Ability to troubleshoot complex platform issues across networking, compute, and storage layers
• A proactive mindset and desire to contribute to large-scale transformation work
• Open to applicants from a variety of industries and backgrounds

Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio are acting as an Employment Business in relation to this vacancy.