Description

You will build and maintain data pipelines within the AWS ecosystem.

Responsibilities

• Develop and manage data pipelines using AWS Glue, S3, and Lambda functions.
• Design and implement data models in Redshift.
• Write and maintain CDK code to support infrastructure.
• Implement test cases to ensure data quality, reliability, and integrity.
• Perform query and application performance tuning using indexes and materialized views.

Required Skills

• 5+ years of experience in data engineering.
• Extensive experience with AWS services, including S3, Glue (catalog and ETL), and Lambda.
• Proficiency in Python and data-focused packages such as Pandas and Numpy.
• Advanced SQL skills, including CTEs, window functions, and temporal data.
• Experience with SAP Hana.
• Knowledge of data lake concepts and Redshift modeling.
• Experience with software engineering practices including Git, branching, and code reviews.
• Ability to work in an agile DataOps environment using Scrum.
• Strong project management and prioritization skills.

Key Skills

Education

Any Graduate