Description

You will design and manage data pipelines and distributed systems within a cloud infrastructure.

Responsibilities

• Design and implement scalable data pipelines and distributed systems.
• Develop complex SQL queries and optimize them for performance.
• Build serverless computing and orchestration workflows using AWS tools.
• Perform data modeling and query tuning within Amazon Redshift.
• Manipulate and process large datasets using PySpark and Python.

Required Skills

• 6+ years of professional experience in Data Engineering or related roles.
• Proficiency in Python and PySpark for data processing.
• Strong expertise in SQL for complex query development and optimization.
• Hands-on experience with AWS Glue, Step Functions, and Lambda.
• Experience with Amazon Redshift, including data modeling.
• Deep understanding of cloud-based solutions and big data technologies.
• Knowledge of data pipeline design and cloud infrastructure.
• Any Graduate degree.

Key Skills

Education

Any Graduate