Senior Big Data Engineer - London - £100,000 + benefits
Lawrence Harvey
London, England
3d ago

Job Description

Senior Big Data Engineer - London - £100,000 + benefits

I am working with a leading IT Services provider to find an experienced Big Data Engineer to work full time onsite in one of their flagship London based projects!

THE ROLE

The Senior Big Data Engineer will join an established Data Engineering team responsible for ingestion through to supporting the user self-

service consumption of data within a Spark / HDFS Data Lake hosted on AWS and using Cloudera distribution.

As a Senior BIG Data Engineer you can expect to be building real-time event driven architecture, setting up and running Big Data Clusters, implementing data ingestion, presenting and generating data catalogues from the metadata repository and exposing that to the various user communities.

THE REQUIREMENTS

  • Previous & successful experience as a Big Data Engineer within a similar role implementing Data Ingestion
  • Solid technical experience of the Hadoop Ecosystem (HDFS, HIVE, Oozie, ZooKeeper etc) and Spark clusters
  • Strong skills in data manipulation using programming languages such as Scala, Python, Java
  • Exceptional skills in data modelling and data acquisition (landing, ingestion, metadata)
  • Expertise in fault tolerant systems in AWS
  • Understanding of configuration management and DevOps (e.g. GitLab, Jenkins etc)
  • Data Prep / Visualisation skills with tools such as Tableau, SpotFire, Talend, Sentry / Impala etc
  • Experience with large scale distributed processing architectures, Lambda etc
  • Experience with Big Data self-describing formats e.e JSON, Parquet, ORC etc)
  • THE OFFER

  • Up to £100,000 base salary
  • 10% bonus
  • Benefits including : 25 days holiday, generous contributory pension, life assurance, various employee retail discounts & vouchers, medical insurance, childcare vouchers, season ticket loan, holiday buy / sell and more...
  • THE COMPANY

    The successful Big Data Engineer will join a globally renowned company with in excess of 200,000 employees world wide and over 20 years of successful trading behind them.

    You will be onsite, full time at one of their flagship multi-year engagements and will be fully supported in not only the development of your technical skills, but also your career to technical lead and beyond.

    Senior Big Data Engineer - London - £100,000 + benefits

    If this sounds like a role that you could be interested in apply now online or send your up to date CV to m.nathaniel lawrenceharvey.com

    Senior Big Data Engineer - London - £100,000 + benefits

    Lawrence Harvey is acting as an employment agency in regards to this position.

    Apply
    Add to favorites
    Remove from favorites
    Apply
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Continue
    Application form