Description

You will design and manage scalable data architectures and automated infrastructure within AWS environments.

Responsibilities

• Onboard diverse data sources into the data lake while ensuring integration and consistency.
• Design, develop, and maintain scalable data pipelines using AWS Lambda, Step Functions, and EMR.
• Automate AWS infrastructure management using Terraform scripting.
• Orchestrate complex workflows using Airflow and Step Functions.
• Optimize data storage solutions using Snowflake and Iceberg table formats.

Required Skills

• 5+ years of experience in cloud architecture or data engineering.
• Proficiency with AWS services including Lake Formation, Step Functions, Lambda, EC2, EMR, and EKS.
• Strong experience with Python and Terraform.
• Hands-on expertise with Spark and big data technologies.
• Experience with Snowflake, Iceberg table formats, RDS, and Jupyter Notebook.
• Proficiency in pipeline orchestration using Airflow and dbt.
• Solid understanding of ETL processes, data warehousing, and data modeling.
• Knowledge of data governance, security, and privacy principles.

Preferred Skills

• AWS Certified Data Engineer or Analytics – Specialty.
• AWS Certified Solutions Architect.

Key Skills

Education

Any Graduate