Description

You will build and maintain data pipelines to process and transform large datasets.

This role is hybrid.

Responsibilities

• Optimize and transform large datasets using SQL.
• Process distributed data using PySpark.
• Manage data workflows leveraging AWS services.
• Implement and maintain ETL processes.
• Develop and manage data deployments via CI/CD pipelines.

Required Skills

• 5+ years of professional experience.
• Expert proficiency in SQL for data transformation.
• Hands-on experience with PySpark for distributed processing.
• Strong knowledge of AWS services including EC2, S3, Lambda, Glue, EMR, Redshift, and RDS.
• Expertise in ETL methodologies.
• Proficiency with version control tools, specifically Git.
• Experience with CI/CD Pipelines for automated deployments.

Key Skills

Education

Any Graduate