Senior Big Data Engineer (scala, spark)
IQVIA Holdings Inc.
London, GB
4d ago

IQVIA are hiring for big data engineers with some experience in scala and apache spark. You will be working in a team of highly talented engineers and data scientists.

Your main responsibility will be to write highly performant and scalable code that will run on top of our Big Data platform (Spark / Hive / Impala / Hadoop).

Also, you will be working closely with the Data Science team to support them in the ETL process (including the cohorts building efforts).

IQVIA™ is The Human Data Science Company™, focused on using data and science to help healthcare clients find better solutions for their patients.

Formed through the merger of IMS Health and Quintiles, IQVIA offers a broad range of solutions that harness advances in healthcare information, technology, analytics and human ingenuity to drive healthcare forward.

  • Working in a cross-functional team alongside talented Engineers and Data Scientists
  • Building scalable and high-performant code
  • Mentoring less experienced colleagues within the team
  • Implementing ETL and Feature Extractions pipelines
  • Monitoring cluster (Spark / Hadoop) performance
  • Working in an Agile Environment
  • Refactoring and moving our current libraries and scripts to Scala / Java
  • Enforcing coding standards and best practices
  • Working in a geographically dispersed team
  • Working in an environment with a significant number of unknowns both technically and functionally.
  • Essential - Strong experience in apache spark and scala
  • Strong analytical and problem solving skills with personal interest in subjects such as math / statistics, machine learning and AI.
  • Practical experience of TDD (test driven development)
  • Practical experience of ScalaTest
  • Practical experience of SQL
  • Practical experience of Git (or similar like Bitbucket)
  • Experience refactoring code with scale and production in mind
  • Experience with integration of data from multiple data sources
  • NoSQL databases, such as HBase, Cassandra, MongoDB
  • Experience with any of the following distributions of Hadoop - Cloudera / MapR / Hortonworks
  • Solid knowledge of data structures and algorithms
  • Degree in Computer Science(or similar) with experience developing software in a commercial environment - alternatively, a relevant combination of education, training and work experience.
  • Other functional Languages such as Haskell and Clojure
  • Big Data ML toolkits such as Mahout, SparkML and H2O
  • Apache Kafka, Apache Ignite and Druid
  • Container technologies such as Docker
  • Cloud Platforms technologies such as DCOS / Marathon / Apache Mesos, Kubernetes and Apache Brooklyn.
  • We thank all applicants for their interest; however only those selected for interview will be contacted.

    Why Join?

    Those who join us become part of a recognized global leader still willing to challenge the status quo to improve patient care.

    In RWS, you will have access to the most cutting-edge technology, the largest data sets, the best analytics tools and, in our opinion, some of the finest minds in the Healthcare industry.

    You can drive your career at IQVIA and choose the path that best defines your development and success. With exposure across diverse geographies, capabilities, and vast therapeutic and information and technology areas, you can seek opportunities to change and grow without boundaries.

    IQVIA is a strong advocate for diversity and inclusion in the workplace. We believe that a work environment that embraces diversity will give us a competitive advantage in the global marketplace and enhance our success.

    We believe that an inclusive and respectful workplace culture fosters a sense of belonging among our employees, builds a stronger team, and allows individual employees the opportunity to maximise their personal potential.


    At IQVIA, we believe in pushing the boundaries of human science and data science to make the biggest impact possible to help our customers create a healthier world.

    The advanced analytics, technology solutions and contract research services we provide to the life sciences industry are made possible by our 70,000+ employees around the world who apply their insight, curiosity and intellectual courage every step of the way.

    Report this job

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Application form