Big Data Engineer
London, United Kingdom
3d ago

Position Description :

If you have a sixth sense for data science, there’s a digital revolution underway in the UK that needs the talents of people who are at home analysing, managing, designing and predicting complex datasets and breathing life into AI systems.

We need a Big Data Engineer to join our innovative UK Advanced Analytics team tasked with creating and managing Big Data infrastructure and tools, typically designing and building big data pipelines and platforms.

From public service transformation to cutting-edge commercial projects, our work has a wide reach, helping make the everyday easier, for everyone.

When you start your CGI story, not only will you be improving people’s lives, you can be sure we’ll do the same for you.

Alongside a competitive salary, we offer you our share scheme (3% + 3% matching) making you a member not just an employee.

You also have the option to benefit from private medical and dental insurance, flexible retirement options, childcare vouchers and a cycle to work scheme.

As for the future? We work as one team, and are a Top 100 employer. Be a successful part of our story and we’ll support you in taking your career anywhere you want it to go.

Your future duties and responsibilities :

CGI have an exciting opening for a Big Data Consultant to work on the collecting, storing, processing, and analysing of huge sets of data.

The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them.

You will also be responsible for integrating them with the architecture used across the business.

As a senior consultant and Big Data expert you will build ETL / ELT best practices in a big data environment, featuring big data pipelines, real time streaming using Kafka and leveraging high levels of proficiency across distributed computing principles.

You will be able to select and integrate any Big Data tools and frameworks required to provide requested capabilities, implementing ETL / ELT process, working closely with Cloud big data architecture (AWS, Azure, GCP) and be an SME in relation to knowledge of big data tools / platforms, data management tools and necessary infrastructure changes.

This represents an exciting opportunity to help build CGI’s UK Advanced Analytics Capability as it takes flight out of our growing Emerging Technology practice.

Required qualifications to be successful in this role :

As the successful candidate you will offer a demonstrable track record in building scalable big data solutions with a view to act as a trusted technology advisor, with core knowledge across a variety of tools and platforms in big data landscape, including appreciation of data management / governance and security.

Necessary skills :

1. Python, Spark for data pipelines

2. Appreciation of ETL / ELT, Lambda architecture, Hadoop, data security & GDPR controls

3. Strong data engineering skills on the Azure Cloud Platform is essential. Other cloud platforms are desirable but not essential.

4. Streaming frameworks like Kafka

5. Understanding of Data Warehousing, Data Modelling techniques

6. Appreciation of database technologies such as noSQL, graph, in-memory databases

7. Attitude to be excited with new technology experimentation in a lab style setup

Nice to have :

1. Snowflake cloud DW

2. Some experience on visualisation tools like Power BI or others, not required at expert level

3. Understanding of Elasticsearch, Hadoop stack, Airflow, Apache ni-fi, Apache Beam, Storm

4. Understanding of Docker, Kubernetes, CI / CD

If you have strong mandatory skills, we will support training and certification on other cloud platforms and technologies using our partnerships with technology providers.

Suffice to say we’re also looking for well-developed interpersonal skills - clear, concise with a passion for latest business innovations and their application to clients’ challenges.

You will need to be keen to learn & develop and CGI will provide you the support and training to help achieve this.


Report this job

Thank you for reporting this job!

Your feedback will help us improve the quality of our services.

My Email
By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
Application form