Senior Data Engineer - Kafka - new job in London, UK

My client, a consultancy based in London, are seeking a Senior Data Engineer with strong experience with Kafka to help build and optimise big data pipelines, architectures and data sets based on batch libraries (Kafka, Spark, Flink)

The ideal candidate must have experience troubleshooting complex data streaming implementations.

The Senior Data Engineer, will play a key part in introducing a streaming data architecture, to provide real-time access to dashboards, Visualisations and reports.

This candidate must have exceptional communication skills as they will need to build strong relationships with the business stakeholders to set expectations and deliver this crucial book of work.

The ideal candidate must have:

• strong experience as a Streaming Data Engineer
• Experience working with streaming platforms, preferably Kafka
• Solid software engineering background with Java, Python or Scala
• Experience designing large-scale data pipelines that utilise any stream-processing frameworks: Kafka Streams or Spark-Streaming
• Experience with CI/CD tools
• Exceptional communication skills
• Strong stakeholder management experience

**Please apply if you have the above skill-set**

Carbon60, Lorien, SRG - the Impellam Group STEM Portfolio is acting as an Employment Business in relation to this vacancy.