Azure Data Engineer

Azure Data Engineer – Amsterdam, NL Experience: 8–10 years Location: Amsterdam, Netherlands Must-Have Skills: - Azure Data Factory (ADF) - Azure Databricks - PySpark - Python - MySQL / SQL - Azure DevOps & CI/CD Key Responsibilities: - Design, develop, and maintain complex data pipelines using Azure Data Factory and Azure Databricks. - Build and optimize large-scale data processing solutions using PySpark and Databricks. - Develop robust Python-based ETL/ELT solutions for data extraction, transformation, and loading. - Implement CI/CD pipelines in Azure DevOps for automated testing, integration, and deployment. - Monitor, troubleshoot, and optimize data pipelines for performance and reliability. - Work with cross-functional teams to understand data requirements and deliver scalable solutions. - Ensure data security, compliance, and adherence to engineering best practices. - Strong SQL skills for querying and managing large datasets. - Excellent problem-solving, communication, and documentation skills.