Description

You will lead data engineering efforts, focusing on ETL pipelines, database management, and serverless data applications within AWS.

This role is on-site.

Responsibilities

• Develop and orchestrate ETL jobs using AWS Glue, including scripting and crawler management.
• Migrate data pipelines, specifically handling Sqoop to Glue transitions.
• Build and maintain serverless data applications leveraging core AWS services.
• Manage data models and implement connectors for MongoDB.

Required Skills

• 7+ years of professional experience in data engineering.
• Proficiency in ETL processes.
• Expertise with AWS Glue services.
• Strong programming skills in PySpark and Scala.
• Experience managing AWS IAM, S3, and CloudWatch.
• Understanding of Spark job lifecycle and AWS EMR.
• Experience with Git and SVN for version control.

Key Skills

Education

Any Graduate