Description

You will design, build, and configure AWS Glue applications to meet specific business process requirements. You own the end-to-end development of ETL jobs, data pipelines, and data quality controls.

Responsibilities

• Design, develop, and maintain AWS Glue ETL jobs to extract, transform, and load data into data lakes and warehouses.
• Build and maintain scalable data pipelines using AWS Glue, ensuring strict data quality and integrity.
• Collaborate with cross-functional teams to analyze requirements and implement technical solutions.
• Troubleshoot and debug issues within AWS Glue ETL jobs and data pipelines to ensure timely resolution.

Required Skills

• Minimum 3 years of experience specifically with AWS Glue.
• Strong understanding of ETL concepts and data integration techniques.
• Proven experience developing and maintaining complex data pipelines.
• Proficiency in troubleshooting and debugging ETL jobs.
• Degree in Computer Science or a related field, or any graduate degree.
• Hands-on experience with AWS S3 for data storage.
• Experience with AWS Lambda for event-driven processing.

Preferred Skills

• Experience with AWS EMR for large-scale data processing.

Key Skills

Education

Any Graduate