Snr DevOps Data Engineer - AWS/K8s/Big data - 6m - Circa £575pd

Contract  |  £525 - £575 per day + Excellent  |  Central London  |  City of London


Snr DevOps Data Engineer - AWS/K8s/Big data - 6m+ - Circa £550pd

Senior DevOps Data Engineer - AWS (ECS), Big data, real time data analysis and streaming platforms (Spark Streaming, Kafka or Kinesis Streams etc), Container virtualization - Docker and Kubernetes, Unix/Linux, Jenkins, GIT, Docker, Scripting (bash or Python), monitoring, security.

Data driven and consumer centric organization are building out a big data platform which Is at the core of it's brands/data products. This platform will provide storage, big data compute, ad-hoc analytical data access, workflow pipeline management and data access services for both existing applications and new experiments. This platform is paramount in delivering deep learning techniques to derive insights that empower the organisations analytical community.

You will work closely with Agile aligned engineering teams in building out this large infrastructure platform at scale in a globally distributed and highly available cloud based system (AWS). On top of this you will be encouraged to automate everything along the way including operational and data driven metrics collection.

Key skills required:

  • AWS (ECS)
  • Building large, complex cloud based infrastructure
  • Familiar working with data engineering/scientists and real time data products
  • Unix/Linux flavours (Networking, info sec)
  • Source code repositories - GIT mostly
  • Continuous Integration - Jenkins
  • Scripting - Bash or Python
  • Container Visualization - Docker, Kubernetes

Nice to have:

  • Real-time analytics and streaming platforms (Spark Streaming, Kafka, Kinesis Streams, etc)
  • Machine learning pipelines in production
  • Knowledge of Distributed Systems
  • Knowledge of No SQL databases like Redis, Cassandra or DynamoDB

Please send your CV

Apply for this Role

Send us your details to consider for this role and tell us a little about yourself

Upload CV (Optional. No CV, no problem. We want to hear from a person, not just a document)

Register for weekly job alerts?

Latest vacancies in DevOps