Description

You will design, develop, and maintain scalable data infrastructure and pipelines within an AWS environment.

Responsibilities

• Onboard diverse data sources into the data lake to ensure integration and consistency.
• Build and maintain scalable data pipelines using AWS Lambda, Step Functions, and EMR.
• Orchestrate complex data workflows using Airflow and Step Functions.
• Implement data quality checks, transformations, and governance to ensure accuracy and security.
• Manage AWS infrastructure through Terraform scripting and automate data registration and metadata management.

Required Skills

• 5+ years of experience in data engineering roles.
• Proficiency with AWS services including Lake Formation, Step Functions, Lambda, EC2, EMR, and EKS.
• Strong programming skills in Python and Terraform.
• Hands-on experience with Spark and big data processing.
• Experience with Snowflake, Iceberg table formats, and RDS.
• Expertise with orchestration tools such as Airflow and dbt.
• Solid understanding of ETL processes, data warehousing, and data modeling.
• Experience using Jupyter Notebook for data tasks.
• Knowledge of data governance principles and security best practices.

Preferred Skills

• AWS Certified Data Engineer or Analytics – Specialty.
• AWS Certified Solutions Architect certification.

Key Skills

Education

Any Graduate