Description

You will design and implement scalable data processing solutions using AWS Glue and related services. You own the end-to-end ETL lifecycle, from development to monitoring and optimization.

This role is on-site.

Responsibilities

• Develop and maintain ETL processes using AWS Glue Studio and AWS Glue ETL for seamless data integration.
• Automate infrastructure provisioning and management using AWS CloudFormation to ensure consistency across environments.
• Monitor and optimize system performance using AWS CloudWatch, proactively identifying and resolving issues.
• Implement DevOps practices using AWS DevOps tools to streamline development workflows and deployment processes.
• Collaborate with cross-functional teams to translate business requirements into technical specifications for cloud-based applications.

Required Skills

• 6+ years of experience in data engineering or backend development.
• Strong proficiency in Python for developing efficient data processing scripts.
• Hands-on experience with AWS Glue, AWS Glue Studio, and AWS DevOps tools.
• Expertise in designing ETL pipelines and data transformation logic.
• Experience with Amazon S3 for data storage management and optimization.
• Proficiency in Apache Spark for distributed data processing and analytics.
• Knowledge of AWS CloudFormation for infrastructure as code.
• Ability to monitor system health using AWS CloudWatch.

Preferred Skills

• Experience mentoring junior developers and providing technical guidance.
• Background in optimizing large-scale data processing solutions for performance.

Key Skills

Education

Any Graduate