As a Data Architect, you will be responsible for the delivery and the development of the data warehouse and supporting infrastructure.
You will also help lead the data engineering team as well as the analytics team. You will choose the best solutions to extend the supported data sets and evolve the data warehousing solutions.
What you need :
Ability to communicate complex technical solutions in a non-technical manner
Strong knowledge of API technologies
Experience using AWS EMR or equivalent Data Lake solutions
Experience with AWS Glue or Apache Hive
Proficient in designing efficient and robust ETL workflows with Spark and other Frameworks
Experience with relational databases ( PostgreSQL , Redshift ) and key-value stores (e.g. Redis )
Experience with Lambda and Kappa Architecture modelling
Experience modelling unstructured data sources in JSON , AVRO , Parquet formats
Professional experience with Python (5+ years) or Spark ( Scala / Python) (5+ year)
Experience working with a workflow management tool (e.g. Luigi , Oozie , Airflow , Azkaban â€ )
Experience of database design and best practices
If you are looking for your next opportunity and you feel like this could be for you, please apply with your CV today!