Data Engineer (Senior) - London - £600-£650pd - 6 Months

Contract  |  £550 - £650 per day + Flexible Remote Working  |  Greater London  |  London

Big Data

Data Engineer (Senior) - London - £600-£650pd - 6 Months

A large retail business with a huge focus on their e-commerce platform (over a billion visits per annum) in London are looking to further strengthen their Analytics / BI team. You will typically deal with all types of Data wrangling challenges on a daily basis, loading data from a variety of both internal and external sources and create robust data pipelines. 3rd parties include AWS, Azure and other cloud providers.

You'll work closely with Data scientists and the head data architect to combine different data streams into common structures. This data is then used to create algorithms to Better understand customers buying habits. Whilst providing Big data Subject matter expertise you'll work within a larger "DevOps" function increases speed to production and sharing responsibility for operational systems.

Essential Skills:

  • Apache Hadoop Ecosystem - Hive, Impala, HBase. Cloudera preferred.
  • Apache Spark
  • Coding Python, Scala, Java.
  • Datawarehouse design & Dev (OLAP, Star schema, Kimball).
  • Database Design and Dev in one or more of the following - Oracle, Microsoft SQL, Server, IBM DB2, MySQL, PostreSQL
  • ETL Experience constructing data flows

Nice to have:

  • Data Analytics (regression testing, clustering, decision trees, Forcasting, Statistics).
  • Streaming data with Kafka or RabbitMQ
  • Continuous integration and containers - Git Jenkins, Docker
  • Data visualisation - PowerBI or Tableau
  • Splunk or Kibana monitoring
  • NoSQL development (MongoDB)
  • Data security understanding with encryption and GDPR
  • Agile development methodologies

Please send your CV

Apply for this Role

Send us your details to consider for this role and tell us a little about yourself

Upload CV (Optional. No CV, no problem. We want to hear from a person, not just a document)

Register for weekly job alerts?

Latest vacancies in Big Data

  • DevOps Engineer

    Contract  |  £550 - £650 per day  |  Greater London  |  London

    Linux  •  Big Data  •  DevOps

    We have had a DevOps contract arise for an exceptionally strong technologist to join and aid with the implementation and expansion of the automation strategy for a renouned company's global platform.It is important for you to have...

    View & apply Register your interest
  • Analytics Manager

    Permanent  |  £50000 - £65000 per annum  |  Central London  |  City of London

    Big Data  •  Infrastructure

    Are you a forward-thinking Analytics Manager, excited by working for an organisation with a customer base of over 12 million people?You will join an exciting online and in-store retail brand as an Analytics Manager, leading a team...

    View & apply Register your interest
  • HPC Engineer (Lustre) - REMOTE

    Contract  |  £500 - £600 per day  |  Greater London  |  London

    Linux  •  Big Data  •  Infrastructure  •  DevOps

    [Fully remote HPC Engineer]You see High-Performance-Computing as the only way to go… To you, systems functioning under a teraflop per second are barely worth calling systems at all. If this applies to you, you've come to the right...

    View & apply Register your interest