Description

You will design, develop, and optimize data pipelines within an AWS environment.

Responsibilities

• Write clean, efficient, and well-documented PySpark and SQL code for data transformations.
• Implement data validation, quality checks, and error-handling mechanisms.
• Build and manage data processing and storage solutions using AWS services.
• Collaborate with cross-functional teams to deliver scalable and reliable data solutions.
• Apply cloud-based data engineering best practices to all workflows.

Required Skills

• 12+ years of experience in data engineering.
• Advanced proficiency in PySpark and SQL.
• Extensive experience with AWS cloud services and their integration.
• Hands-on experience with AWS S3 and AWS Glue.
• Experience using AWS Redshift and AWS Lambda.
• Proficiency with AWS EMR and AWS Athena.
• Experience working with AWS DynamoDB.
• Bachelor's degree in any field.

Key Skills

Education

Any Graduate