Data Platform Engineer

Data Platform Engineer - Kubernetes/Docker/Spark/Python

6 Months

Remote

Inside IR35

My client a global pharmaceutical company are currently looking to recruit a number of Data Engineers to join their team on a contract basis remotely. Please note if successful you will need to be paid via an umbrella company/PAYE. As a Data Engineer you will be required to support the Data Framework and Ops organisation to ensure our client efficiently, reliably, transparently, and at scale through the creation of a leading-edge, cloud-native data services framework.

Qualifications

• Experience with common distributed data tools in a production setting (Spark, Kafka, Hive, Presto, etc.)
• Experience with Python and / or Spark jobs is essential
• Kubernetes and Docker experience
• Containerisation experience with docker/spark and coding in Kubernetes
• Experience with specialized data architecture (e.g. data lake, lake house, data fabric, data mesh, optimizing physical layout for access patterns)
• Experience with public cloud providers like AWS, Azure and GCP
• Experience with search / indexing systems (e.g. Elasticsearch)
• Practical experience with agile software development and DevOps-forward ways of working

Desirable Qualifications

If you have the following characteristics, it would be a plus:

• Experience building and designing a DevOps first way of working
• Demonstrated excellence writing production Python, Java, Scala, Go, and/or C#/C++
• Demonstrated experience building reusable components on top of the CNCF ecosystem including platforms like Kubernetes (or similar ecosystem)
• Metrics-first mindset

Lorien Plc is acting as an Employment Business in relation to this vacancy.