Databricks Tech Lead
RemoteCounty Dublin, IrelandseniorFull-time
- Posted
- today
- Source
- LinkedIn (remote, Europe)
- Field
- Engineering
Skills
LeadershipSecurityPythonAzureSparkSQLAWSETL
Description
Databricks Tech Lead
Location: Dublin, Ireland (Hybrid)
We are looking for a hands-on Databricks Tech Lead with strong engineering fundamentals and deep practical experience with Databricks. You will lead the technical design and development of data engineering solutions, while remaining actively involved in coding, platform optimisation and technical decision-making.
Key Responsibilities
- Lead the design, development and delivery of scalable data engineering solutions using Databricks.
- Drive hands-on development across data pipelines, data processing and ETL/ELT workflows.
- Provide technical leadership, conduct code reviews and establish engineering best practices.
- Optimise data pipelines and Spark workloads for performance, reliability and cost.
- Ensure data quality, governance, security and platform reliability.
- Work closely with data engineers, architects and stakeholders to deliver robust solutions.
- Troubleshoot complex technical issues and support continuous improvement.
Key Requirements
- Strong hands-on experience with Databricks in a production environment.
- Extensive data engineering experience, including building and maintaining complex data pipelines.
- Strong proficiency in Python, PySpark and SQL.
- Solid understanding of Apache Spark, distributed processing and performance optimisation.
- Experience with Delta Lake, lakehouse architecture and data pipeline orchestration.
- Experience with cloud data platforms, ideally Azure or AWS.
- Proven ability to lead engineers, make technical decisions and drive delivery.
- Strong problem-solving skills and a focus on engineering quality.
Ideal Candidate
A technically strong data engineer who combines deep Databricks expertise with hands-on development and the ability to lead a team. This is an engineering-led role, so we need someone who can design, build, optimise and lead, rather than someone focused purely on architecture or people management.
JobMatch aggregates public listings. Always apply through the original posting.