Luxoft_Senior Data Engineer / Developer (AWS)

The Senior Data Engineer will design, build, and optimize large-scale data infrastructure, ensuring efficient data collection, processing, and availability to support advanced analytics and data-driven decision-making. Role description: - Design ETL/ELT pipelines for network telemetry data - Interface with on-premises data collection systems - Implement Iceberg table structures, also for time-series data • Optimize data processing for analytics • Manage data quality and lineage • Implement pipeline observability - Implement modern data protection strategies Qualifications: - 5+ years experience with AWS Glue, S3, Athena, IAM, Lakeformation, Lambda, S3 Tables - Apache Iceberg and lakehouse architectures - Java (Python, Scala) for data processing - Familiarity with data formats (JSON, Avro, Parquet) • Time-series database queires - Data processing (Spark, DuckDB, Flink, AirFlow, Prefect) • Graph Theory • Excellent SQL Knowledge • English: B1 Nice to have: • AWS Certifications Originally posted on Himalayas