Description

Build and maintain data pipelines within the AWS ecosystem, owning the full lifecycle from infrastructure-as-code to query optimization.

Responsibilities

• Develop and manage data pipelines using AWS Glue (catalog and ETL), S3, and Lambda functions.
• Design and implement data models in Redshift.
• Maintain infrastructure using CDK code and follow software engineering best practices including Git, branching, and code reviews.
• Write test cases to ensure data quality, reliability, and confidence.
• Optimize query and application performance through indexing, materialized views, and tuning.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency in Python and data-focused libraries like Pandas and Numpy.
• Advanced SQL skills, including CTEs, window functions, and temporal data.
• Deep knowledge of AWS data lake concepts, S3, Glue, Lambda, and Redshift.
• Hands-on experience with CDK for infrastructure development.
• Proficiency with Git and working within a Scrum/Agile DataOps environment.
• Experience with SAP Hana.
• Ability to manage projects, organization, and prioritization.

Key Skills

Education

Any Graduate