ETL Developer

Key Responsibilities - Design, develop, and maintain ETL/ELT data pipelines. - Extract data from databases, APIs, files, and other sources. - Transform and cleanse data according to business requirements. - Load processed data into data warehouses or data lakes. - Develop SQL queries, stored procedures, and data transformations. - Perform data validation, reconciliation, and quality checks. - Monitor ETL jobs and troubleshoot failures and performance issues. - Optimize ETL workflows and database queries for better performance. - Work with data analysts, business teams, and data engineers to understand requirements. - Maintain technical documentation for data pipelines and processes. - Implement error handling, logging, and recovery mechanisms. - Participate in testing, deployment, and production support. Required Skills - Strong SQL and database concepts. - Experience with ETL tools such as Informatica, SSIS, Talend, or DataStage. - Knowledge of databases such as Oracle, SQL Server, MySQL, or PostgreSQL. - Understanding of data warehousing concepts such as fact tables, dimension tables, star schema, and slowly changing dimensions (SCD). - Good understanding of data integration and data quality. - Familiarity with scripting languages such as Python is often preferred. - Knowledge of cloud platforms such as AWS, Azure, or GCP is an advantage. - Understanding of scheduling/orchestration tools such as Airflow is beneficial. - Good problem-solving and communication skills.