Data Engineer (Databricks, PySpark, SQL)

My responsibilities: - Design, develop, optimize, and maintain squad-specific data architectures and pipelines in line with ETL and data lake principles - Prepare, align, and hand over data architecture and pipeline artefacts to the platform team for reuse across squads - Solve complex technical data challenges that support business objectives - Develop data products for analytics, data scientists, and ML engineers to improve productivity within the team and across the organization - Advise, mentor, and support data and analytics professionals on data standards and best practices within the squad and organization - Contribute to the evaluation of emerging tools in data engineering and data science, helping to define and improve standards and ways of working - Drive continuous improvement by contributing to training, capability development, and enhancements in analytical data engineering practices, standards, and processes The knowledge I own: - Degree in Computer Science or related field - 10+ years of experience in software or infrastructure development, including at least 4 years in data engineering within distributed computing, big data, or advanced analytics environments - Strong expertise in SQL and data analysis, with proficiency in at least one programming language such as Python or Scala - Experience in database development and data modeling, ideally with Databricks/Spark and SQL Server; knowledge of relational, NoSQL, and cloud-based databases. - Solid understanding of distributed computing concepts, preferably with Spark or MapReduce - Hands-on experience with Azure tools such as Azure Data Factory, Azure Databricks, Event Hub, Synapse, and ML services - Good understanding of data and analytics concepts, including dimensional modeling, ETL, data warehousing, reporting, data governance, and handling structured and unstructured data - Familiarity with Unix systems, especially shell scripting - Basic knowledge of network concepts, connectivity, and troubleshooting - Foundational understanding of machine learning, data science, AI, statistics, or applied mathematics - Strong communication skills and fluent English; German is a plus Tech Stack - Azure Databricks - Azure Data Factory - Python - PySpark - ServiceNow - M365 - and other tools depending on the role The offer that would convince me: - We develop and maintain our own product with high emphasis on quality and long-term stability - Code quality matters: we follow Clean Code and SOLID principles backed by robust testing - Flexible working hours and remote work options - Competitive salary with regular adjustments based on inflation and loyalty - Access to continuous learning via our internal learning platform and expert communities Online application: Please use our online application and attach your resume. AIIS Adatkezelési tájékoztató Privacy notice