I am current looking for a Big Data Engineer to join one of the largest data science companies in the Pharma and life sciences industries.
You will be working in a team of highly talented Engineers and Data Scientists. Your main responsibility will be to write highly performant and scalable code that will run on top of our Big Data platform (Spark / Hive / Impala / Hadoop).
In addition, you will be working closely with the Data Science team to support them in the ETL process (including the cohorts building efforts).
A typical day might include :
Working in a cross-functional team - alongside talented Engineers and Data Scientists
Building scalable and high-performant code
Mentoring less experienced colleagues within the team
Implementing ETL and Feature Extractions pipelines
Monitoring cluster (Spark / Hadoop) performance
Working in an Agile Environment
Refactoring and moving our current libraries and scripts to Scala / Java
Enforcing coding standards and best practices
Working in a geographically dispersed team
Working in an environment with a significant number of unknowns - both technically and functionally.
Ideal experience :
BSc or MSc in Computer Science or related field
Strong analytical and problem-solving skills with personal interest in subjects such as math / statistics, machine learning and AI
Solid knowledge of data structures and algorithms
Experience working in an Agile environment using Test Driven Development (TDD) and Continuous Integration (CI)
Experience refactoring code with scale and production in mind.
Our ideal candidate : Tech Skills
Proficient in Scala, Java and SQL
Strong experience with Apache Spark, Hive / Impala and HDFS
Familiar with Python, Unix / Linux, Git, Jenkins, JUnit and ScalaTest
Experience with integration of data from multiple data sources
Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
Experience with any of the following distributions of Hadoop - Cloudera / MapR / Hortonworks.
This is a fantastic opportunity to join world-renowned company; in return, they can offer you a competitive salary and a great benefits package including Â£5,000 car allowance and 15% bonus.
If you would like to find out more regarding this fantastic opportunity, please get in touch ASAP!