Databricks Data Engineer

Databricks Data Engineer - Leeds - Up to £70,000

Location: Leeds (Hybrid - 2 days per week onsite)
Job Type: Permanent

About the Company

Our client is a rapidly growing data‑driven consultancy helping enterprise‑scale organisations modernise their data estates. With several major new projects kicking off in early 2026, they are expanding their Leeds engineering hub and looking for a Databricks-focused Data Engineer to join their high‑performing team.

You will design, build, and optimise cloud-based data pipelines that feed analytics, AI, and real-time insights. You'll work closely with architects, analysts, and platform teams to deliver scalable, high‑quality data solutions.

Key Responsibilities:

• Develop, optimise, and maintain ETL/ELT pipelines within Databricks
• Build reliable data ingestion frameworks using PySpark and Spark SQL
• Design well-structured data models across medallion/lakehouse architecture
• Work with DevOps teams to automate deployments using CI/CD
• Collaborate with stakeholders to understand analytical needs
• Ensure compliance with best practices around data governance, security, and quality

Requirements:

• Strong experience with Databricks (jobs, notebooks, workflows, Delta Live Tables)
• Proficiency in PySpark and Python
• Hands-on experience with Azure Data Lake, Azure Data Factory, or similar cloud services
• Understanding of Delta Lake, streaming pipelines, and lakehouse architecture
• Solid knowledge of data engineering principles (ETL/ELT, modelling, optimisation)

Benefits:

• Salary up to £70,000
• Annual bonus
• Structured career development and funded certifications
• Opportunity to work on high-impact, enterprise-scale data transformation programmes