Databricks Data Engineer

Databricks Data Engineer | B2B Contract | 12 Months | Hybrid, North Dublin Location: North Dublin, Ireland (Hybrid) Contract: B2B, 12 months Start date: ASAP TechShack is partnering with a leading organisation in North Dublin to find an experienced Databricks Data Engineer for a 12-month B2B contract. You’ll join a growing data team to design, build and optimise modern data platforms on Databricks, delivering reliable, scalable pipelines that drive key business decisions. What you’ll be doing - Designing, building and maintaining scalable data pipelines on Databricks - Developing ETL/ELT processes with PySpark, Spark SQL and Delta Lake - Putting Lakehouse architecture and Medallion (Bronze, Silver, Gold) design patterns in place - Working with stakeholders to turn business needs into strong data solutions - Tuning Spark jobs and Databricks clusters for performance and cost - Setting up data quality, governance and security best practice, including Unity Catalog - Building CI/CD pipelines and following engineering best practice across the data platform - Supporting migration of legacy data workloads to Databricks What we’re looking for - Strong commercial experience as a Data Engineer with hands-on Databricks delivery - Advanced skills in Python/PySpark and SQL - Solid experience with Delta Lake, Spark and Lakehouse architecture - Experience with at least one major cloud platform (Azure, AWS or GCP) - Knowledge of Unity Catalog, Databricks Workflows and Delta Live Tables - Experience with CI/CD, Git and infrastructure as code (e.g. Terraform) - Strong communication skills and confidence working directly with stakeholders - Able to work onsite in North Dublin 3-4 days per week Nice to have - Databricks certifications (Data Engineer Professional) - Experience with streaming data (Structured Streaming, Kafka, Event Hubs) - Experience with dbt, Airflow or similar orchestration tools - Background in consultancy or enterprise data delivery Why apply? - 12-month contract with a long-term, high-impact data programme - Work with a modern Databricks Lakehouse stack - Hybrid working with a collaborative onsite team in North Dublin - ASAP start for the right candidate How to apply If this sounds like you, apply now with your latest CV and we’ll be in touch to talk through the role in more detail.