Data Framework Engineer II
Brentford, United Kingdom
4d ago

The mission of the Data Science and Data Engineering (DSDE) organization within GSK Pharmaceuticals R&D is to get the right data, to the right people, at the right time.

The Data Framework and Ops organization ensures we can do this efficiently, reliably, transparently, and at scale through the creation of a leading-edge, cloud-native data services framework.

We focus heavily on developer experience, on strong, semantic abstractions for the data ecosystem, on professional operations and aggressive automation, and on transparency of operations and cost.

We are looking for a skilled Data Framework Engineer II to join our growing team. The Data Framework team builds and manages (in partnership with Tech) reusable components and architectures designed to make it both fast and easy to build robust, scalable, production-grade data products and services in the challenging biomedical data space.

A Data Framework Engineer II knows the metrics desired for their tools and services and iterates to deliver and improve on those metrics in an agile fashion.

A Data Framework Engineer II is a highly technical individual contributor, building modern, cloud-native systems for standardizing and templatizing data engineering, such as :

  • Standardized physical storage and search / indexing systems
  • Schema management (data + metadata + versioning + provenance + governance)
  • API semantics and ontology management
  • Standard API architectures
  • Kafka + standard streaming semantics
  • Standard components for publishing data to file-based, relational, and other sorts of data stores
  • Metadata systems
  • Tooling for QA / evaluation
  • Additional responsibilities also include :

  • Given a well-specified data framework problem, implement end-to-end solutions using appropriate programming languages (e.
  • g. Python, Scala, or Go), open-source tools (e.g. Spark, Elasticsearch, ...), and cloud vendor-provided tools (e.g. Amazon S3)

  • Leverage tools provided by Tech (e.g. infrastructure as code, Cloud Ops, DevOps, logging / alerting, ...) in delivery of solutions
  • Write proper documentation in code as well as in wikis / other documentation systems
  • Write fantastic code along with the proper unit, functional, and integration tests for code and services to ensure quality
  • Stay up to date with developments in the open-source community around data engineering, data science, and similar tooling
  • The DSDE team is built on the principles of ownership, accountability, continuous development, and collaboration. We hire for the long term, and we're motivated to make this a great place to work.

    Our leaders will be committed to your career and development from day one.

    Why you?

    Basic Qualifications :

    We are looking for professionals with these required skills to achieve our goals :

  • PhD in Computer Science with a focus in Data Engineering, DataOps, DevOps, MLOps, Software Engineering OR Masters and 2+ years experience
  • Experience with common distributed data tools (Spark, Kafka, etc)
  • Experience with basics of data architecture (e.g. optimizing physical layout for access patterns)
  • Experience with basics of search engines / indexing (e.g. Elasticsearch, Lucene)
  • Demonstrated experience in writing Python, Scala, Go, and / or C++
  • Preferred Qualifications :

    If you have the following characteristics, it would be a plus :

  • Experience with agile software development
  • Experience building and designing a DevOps-first way of working
  • Demonstrated experience building reusable components on top of the CNCF ecosystem including Kubernetes (or similar ecosystem)
  • Experience with schema tools and schema management (Avro, Protobuf)
  • Report this job

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Application form