Description

You will build and maintain data pipelines using AWS services.

Responsibilities

• Design and implement ETL processes using AWS Glue and EMR.
• Manage and optimize data workflows using tools like Kafka and Airflow (MWAA).
• Develop data solutions using Python, integrating with AWS services like S3, Redshift, and DMS.
• Tune SQL queries and optimize existing ETL jobs for performance.

Required Skills

• 4 to 8 years of professional experience in data engineering.
• Proficiency in Python, Java, or Scala, with Python preferred.
• Hands-on experience with AWS services: S3, Glue, EMR, Redshift, SNS, SQS, DMS, MWAA.
• Experience with Infrastructure as Code using Terraform.
• Strong understanding of SQL tuning and ETL optimization techniques.
• Familiarity with streaming tools such as Kafka and Kinesis.
• Experience with monitoring tools like Splunk or CloudWatch.

Key Skills

Education

Not specified