Data Engineer

Job Title: Data Engineer (PySpark / Scala / Python) Location: Remote Job Description: We are hiring a Data Engineer with strong hands-on experience in PySpark, Scala, and Python. You must have solid expertise in Apache Spark, as it will be the core technology used for building and managing large-scale data processing pipelines. Experience with cloud platforms like Google Cloud Platform (GCP), Microsoft Azure, or AWS is a plus. Required Skills: - Strong hands-on experience with Apache Spark - Proficient in PySpark - Experience in Scala and Python - Knowledge of ETL processes and data pipeline design - Understanding of distributed data processing - Familiarity with version control tools like Git - Basic knowledge of cloud platforms (GCP, AWS, or Azure) Nice to Have: - Experience with cloud-native data tools (e.g., Dataproc, Glue, EMR, BigQuery) - Familiarity with workflow/orchestration tools like Airflow or Cloud Composer - Experience with CI/CD for data engineering - Exposure to both structured and unstructured data Originally posted on Himalayas