Big Data Engineer
Computer Futures
London, England
4d ago

I am current looking for a Big Data Engineer to join one of the largest data science companies in the Pharma and life sciences industries.

You will be working in a team of highly talented Engineers and Data Scientists. Your main responsibility will be to write highly performant and scalable code that will run on top of our Big Data platform (Spark / Hive / Impala / Hadoop).

In addition, you will be working closely with the Data Science team to support them in the ETL process (including the cohorts building efforts).

A typical day might include :

  • Working in a cross-functional team - alongside talented Engineers and Data Scientists
  • Building scalable and high-performant code
  • Mentoring less experienced colleagues within the team
  • Implementing ETL and Feature Extractions pipelines
  • Monitoring cluster (Spark / Hadoop) performance
  • Working in an Agile Environment
  • Refactoring and moving our current libraries and scripts to Scala / Java
  • Enforcing coding standards and best practices
  • Working in a geographically dispersed team
  • Working in an environment with a significant number of unknowns - both technically and functionally.
  • Ideal experience :

  • BSc or MSc in Computer Science or related field
  • Strong analytical and problem-solving skills with personal interest in subjects such as math / statistics, machine learning and AI
  • Solid knowledge of data structures and algorithms
  • Experience working in an Agile environment using Test Driven Development (TDD) and Continuous Integration (CI)
  • Experience refactoring code with scale and production in mind.
  • Our ideal candidate : Tech Skills

  • Proficient in Scala, Java and SQL
  • Strong experience with Apache Spark, Hive / Impala and HDFS
  • Familiar with Python, Unix / Linux, Git, Jenkins, JUnit and ScalaTest
  • Experience with integration of data from multiple data sources
  • Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
  • Experience with any of the following distributions of Hadoop - Cloudera / MapR / Hortonworks.
  • This is a fantastic opportunity to join world-renowned company; in return, they can offer you a competitive salary and a great benefits package including £5,000 car allowance and 15% bonus.

    If you would like to find out more regarding this fantastic opportunity, please get in touch ASAP!

    Apply
    Add to favorites
    Remove from favorites
    Apply
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Continue
    Application form