Data Engineer

Permanent  |  £55000 - £70000 per annum  |  Greater London  |  London

Big Data  •  Back End Development

Work directly on a successful app with over 100 million users at the core of the product, joining a successful data team.

You will be working on delivering a new self-service data platform, that will be built with Scala, Spark, Python, CI/CD and Infrastructure as code, alongside an experienced technical team.

You are a data engineer with experience working on large scale projects in real-time stream processing of data. Your experience is solid in Spark and Scala or Python (both would be great!) with a heavy TDD approach to your code. You will also work heavily with cloud technologies and distributed systems.

Ideally, you are someone who has solid experience in systems and software design as you will be building and designing datasets from scratch within a highly scalable environment. advancing the existing data infrastructure.

You will work with the following technologies, however, you don't need experience in all;

• Scala

• Spark

• Python

• AWS

• Lambda

• Kinesis

• Hive

• Jenkins

• Packer

• Docker

• Kubernetes

With the technologies above, you will be crucial to the significant impact on the success and reliability of the product joining an exciting team within a growing business.

You will be joining a team of continuous learners and will always face new challenges within this team. We're looking for you to bring on your expertise, whilst also taking each day as a new learning opportunity.

As well as working within an ever-growing industry where technology is key, you will work in a social, modern environment centred around ownership and trust.