Description

You will design, develop, and maintain scalable data infrastructure and pipelines within an AWS environment.

Responsibilities

• Onboard diverse data sources into the data lake to ensure seamless integration and consistency.
• Design and maintain scalable data pipelines using AWS Lambda, Step Functions, and EMR.
• Orchestrate complex data workflows using Airflow and Step Functions.
• Implement data quality checks, transformations, and governance to ensure security and compliance.
• Automate AWS infrastructure management using Terraform scripting.

Required Skills

• 5+ years of experience in data engineering roles.
• Proficiency with AWS services including Lake Formation, Step Functions, Lambda, EC2, EMR, and EKS.
• Strong experience with Python and Terraform.
• Hands-on expertise with Spark and big data technologies.
• Experience using Airflow, dbt, and Jupyter Notebook.
• Working knowledge of Snowflake, Iceberg, and RDS.
• Solid understanding of ETL processes, data warehousing, and data modeling.
• Ability to manage metadata and register data sources for discoverability.

Preferred Skills

• AWS Certified Data Engineer, Analytics Specialty, or Solutions Architect certifications.

Key Skills

Education

Any Graduate