Data Engineer

Our client is seeking a skilled and motivated  Data Engineer  to play a key role in the creation of a  brand-new data platform  within the Azure ecosystem including Azure Data Factory (ADF), Synapse and PySpark / Databricks and Snowflake.

You will be a data ingestion and ETL Pipeline guru, tackling complex problems at source in order to retrieve the data and ensure to can flow upstream to the Snowflake DWH. You will not be an analytics engineer or someone who operates at the latter stages of the development lifecycle unless you have skills and desire to work on data ingestion, ETL / ELT.

• Build & Develop  robust ETL / Data Ingestion pipelines leveraging Azure Data Factory, Synapse, PySpark and Python. Connect APIs, databases, and data streams to the platform, implementing ETL/ELT processes.
• Data Integrity  – Embed quality measures, monitoring, and alerting mechanisms.
• CI/CD & Automation  – Create deployment pipelines and automate workflows.
• Collaboration  – Work with stakeholders across  Global IT, Data, and Broking  teams to translate business requirements into technical solutions.
• Futureproofing  – Drive the evolution of the data platform, ensuring adaptability for new data sources, analytical models, and emerging technologies.

• Extensive hands-on experience  with  Microsoft Azure data tools  (Azure Data Factory, Azure Synapse, or Azure SQL).
• Strong  ETL/ELT  development skills.
• Python  experience
• Experience with  CI/CD methodologies  for data platforms.
• Knowledge of  MS SQL Server, SSIS, Visual Studio, and SSDT projects .

The  Data Engineer  will make a significant impact quickly as this global business who handle HUGE amounts of data build out their new data platform to support them and their clients to be more analytically driven and leverage data to the maximum.

If you’re ready to take on a challenging and rewarding role (will get to learn snowflake if you don't already have it! apply today!