Description

Build and manage cloud-native data pipelines on AWS, focusing on streaming ETL and infrastructure automation.

This role is on-site.

Responsibilities

• Develop and maintain ETL streaming pipelines using PySpark.
• Design and implement data workflows leveraging AWS services like SQS, Lambda, S3, and RDS.
• Manage cloud infrastructure using Terraform.
• Build and operationalize data solutions with a focus on cloud-native patterns.

Required Skills

• 5+ years of applied experience in software engineering concepts.
• Extensive hands-on experience with PySpark and ETL streaming pipelines.
• Advanced proficiency in Python.
• Deep understanding of AWS services, including Glue and EMR.
• Experience with core AWS components: SQS, Lambda, S3, and RDS.
• Proficiency in using Terraform for infrastructure management.
• Experience with SQL.

Preferred Skills

• Familiarity with Alteryx or Tableau.
• Experience with Shell scripting and Unix systems.

Key Skills

Education

Any Gradute