Data Engineer-Conversational Analytics

My responsibilities: - Provide trusted data for conversational analytics, including a semantic layer, metric definitions, and a business glossary that text-to-SQL questions can use - Maintain, develop, and optimize the data layer of AI us cases in the global data lake environment, ensuring high data quality, reliability, and overall performance - Design and implement high-performance data processing pipelines and workflows utilizing Python, Spark, and Databricks - Manage scalable and efficient data integration and processing solutions using Databricks - Establish robust data management processes and execute advanced data querying and quality control with SQL and big data technologies - Automate operational tasks and support infrastructure maintenance by leveraging shell scripting and foundational UNIX knowledge - Support data modelling initiatives for coherent structure design and document all technical processes to ensure operational continuity The knowledge I own: - Strong background and understanding of database data management (general SQL knowledge, data querying, data quality control) - Strong programming knowledge in Python (pyspark) - Advanced level Big Data / data lake framework (Spark, Databricks) - Strong cloud knowledge and handling of Databricks - Basic familiarity with UNIX operating system, especially shell scripting - Basic understanding of network level problems and connectivity requirements - Basic understanding of data modelling principles and semantic layers (metric definitions, business glossaries) for conversational analytics - Data-centric mindset - Structured, analytical thinking - Strong communication skills - Well-organized The offer that would convince me: - A constantly growing organization and increasing opportunities - Secure, long-term job opportunity - Varied and engaging job responsibilities - The chance to build data products used by colleagues across the international organization - Outstanding salary - Flexible work arrangements - Home office possibility