Description

You will design and maintain scalable data infrastructure and pipelines within an AWS environment.

Responsibilities

• Onboard diverse data sources into the data lake, ensuring consistency and seamless integration.
• Build and maintain scalable data pipelines using AWS Lambda, Step Functions, and EMR.
• Orchestrate complex workflows using Airflow and Step Functions while implementing data quality checks and transformations.
• Manage infrastructure as code using Terraform to automate AWS environments.
• Design and optimize data storage solutions using Snowflake and Iceberg table formats.

Required Skills

• 5+ years of experience in data engineering roles.
• Proficiency with AWS services including Lake Formation, Step Functions, Lambda, EC2, EMR, and EKS.
• Strong programming skills in Python.
• Hands-on experience with Spark and big data processing.
• Expertise in data pipeline orchestration using Airflow and dbt.
• Experience with Terraform for infrastructure automation.
• Working knowledge of Snowflake, Iceberg table formats, RDS, and Jupyter Notebook.
• Solid understanding of ETL processes, data warehousing, and data modeling.
• Knowledge of data governance, privacy, and compliance principles.

Preferred Skills

• AWS Certified Data Engineer, Analytics – Specialty, or Solutions Architect certifications.

Key Skills

Education

Any Graduate