Description

You will lead the data engineering function, building and optimizing large-scale data pipelines for analytics and cloud transformation initiatives.

This role is on-site.

Responsibilities

• Create and optimize data engineering pipelines for analytics projects.
• Develop and maintain automated ETL processes with robust error recovery and exception handling.
• Partner with stakeholders to define data requirements and build high-quality ingestion systems.
• Support data and cloud transformation initiatives.
• Contribute to cloud strategy based on technical experience.

Required Skills

• 5+ years of engineering experience in Big Data.
• Advanced proficiency with Apache Spark, Scala, and Python.
• Advanced SQL skills, including performance tuning.
• Experience writing Spark streaming jobs integrated with Apache Kafka.
• Hands-on experience with AWS services: EMR, Glue, S3, Athena, IAM, Lambda, and CloudWatch.
• Proficiency in Shell Scripting.
• Experience using external job schedulers like Airflow.
• Bachelor’s degree required.

Key Skills

Education

Bachelor’s degree