I'm currently working with a client who is looking for an experienced Azure Databricks Engineer to work 3 days on site in London. You will join a data transformation programme. The role will involve designing and optimising data pipelines, integrating multiple data sources, and ensuring the reliability and scalability of the data platform.
Key Responsibilities:
Design, develop, and optimize data pipelines using Azure Databricks.
Ensure data reliability, scalability, and quality.
Integrate data sources into a unified platform.
Monitor and troubleshoot data workflows.
Skills Required:
Expertise in Azure Databricks, Spark, and big data tools.
Strong SQL skills
Knowledge of Python, ETL processes and cloud technologies.
Familiarity with CI/CD practices for data pipelines.
Experience within the insurance sector would be highly beneficial
If this aligns with your skillset, you are available within 2 weeks and can work 3 days on site in central London per week then please apply for the job advert directly.