Snr DevOps Data Engineer - AWS/K8s/Big data - 6m - Circa £575pd

Contract  |  £525 - £575 per day + Excellent  |  Central London  |  City of London

DevOps

Snr DevOps Data Engineer - AWS/K8s/Big data - 6m+ - Circa £550pd

Senior DevOps Data Engineer - AWS (ECS), Big data, real time data analysis and streaming platforms (Spark Streaming, Kafka or Kinesis Streams etc), Container virtualization - Docker and Kubernetes, Unix/Linux, Jenkins, GIT, Docker, Scripting (bash or Python), monitoring, security.

Data driven and consumer centric organization are building out a big data platform which Is at the core of it's brands/data products. This platform will provide storage, big data compute, ad-hoc analytical data access, workflow pipeline management and data access services for both existing applications and new experiments. This platform is paramount in delivering deep learning techniques to derive insights that empower the organisations analytical community.

You will work closely with Agile aligned engineering teams in building out this large infrastructure platform at scale in a globally distributed and highly available cloud based system (AWS). On top of this you will be encouraged to automate everything along the way including operational and data driven metrics collection.

Key skills required:

  • AWS (ECS)
  • Building large, complex cloud based infrastructure
  • Familiar working with data engineering/scientists and real time data products
  • Unix/Linux flavours (Networking, info sec)
  • Source code repositories - GIT mostly
  • Continuous Integration - Jenkins
  • Scripting - Bash or Python
  • Container Visualization - Docker, Kubernetes

Nice to have:

  • Real-time analytics and streaming platforms (Spark Streaming, Kafka, Kinesis Streams, etc)
  • Machine learning pipelines in production
  • Knowledge of Distributed Systems
  • Knowledge of No SQL databases like Redis, Cassandra or DynamoDB

Please send your CV

Apply for this Role

Send us your details to consider for this role and tell us a little about yourself

Upload CV (Optional. No CV, no problem. We want to hear from a person, not just a document)

Register for weekly job alerts?

Latest vacancies in DevOps

  • DevOps Engineer - Mesos

    Permanent  |  £600 - £650 per day  |  Greater London  |  London

    Linux  •  DevOps

    We have an opportunity for someone working within DevOps to be involved in a production implementation of Mesos / Marathon. If you have expertise with Kubernetes expertise, and want to get another orchestration tool experience under...

    View & apply Register your interest
  • Devops Engineer DM

    Contract  |  £600 - £625 per day  |  Greater London  |  London

    DevOps

    Implementation of Global Kubernetes Platform …… Interested?You could be the DevOps engineer who is responsible for building a global Kubernetes platforms for an international E-commerce company operating in the United States, Europe,...

    View & apply Register your interest
  • Senior Linux Engineer

    Permanent  |  £120000 - £160000 per annum  |  Greater London  |  London

    Linux  •  DevOps

    We are looking for an experienced Linux Engineer to become part of a leading global Investment Banking Company, based in one of the main financial centres of the UK. You will be working within the organisations Low Latency team to...

    View & apply Register your interest