Job description
Our client, a national tech consultancy, is looking for a Data Engineer with experience in Data Development, ETL, Data Warehousing and dealing with large sets of structured, semi-structured and unstructured data to join any of their UK offices.
Responsibilities :
As a data engineer you’ll help their clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps culture.
You’ll work in a fast-moving, agile environment, within multi-disciplinary teams, delivering modern data platforms into large organisations.
You’ll get to work with some of the brightest and best in the industry on some of the most exciting digital programmes around.
Skills :
Python
Python
AWS or Azure data services (e.g. Data Factory, Synapse, Redshift, Glue, Athena)
Databricks or Apache Spark.
NoSQL databases (e.g. HBase, Cassandra).
Stream processing technologies such as Kafka, Kinesis.
Hadoop ecosystem exposure.
Benefits :
Work on exciting projects
Extensive training and development opportunities
25 Days holiday
Bonus scheme
Pension scheme and private healthcare insurance
As a Data Engineer you will work as part of an Agile development team across the entire project life-cycle from discovery to implementation, identifying data sources, analysing datasets, developing extract, transformation and load processes and creating single sources of truth.
The role will involve providing guidance around data validation and helping to build a more in-depth understanding of real data usage, especially around data quality and process improvement.