Description

Key Skills: AWS (S3, Glue, EMR), PySpark, AWS Glue, ETL Development, Data Pipelines, Data Engineering

Roles & Responsibilities:

• Build and optimize AWS-based data pipelines for ingestion, transformation, and data delivery.
• Develop ETL jobs using PySpark and AWS Glue, including schema handling, transformations, and performance tuning.
• Implement data quality checks and monitoring to ensure pipeline reliability and correctness.
• Design partitioning, file formats, and storage strategies in AWS to improve query and processing performance.
• Collaborate with analytics and engineering teams to integrate data products and support downstream consumption.

Experience Required:

• 6-12 years of relevant Data Engineering experience.
• Experience with AWS data services and pipeline deployment.
• Strong experience in ETL development using AWS Glue.
• Experience in scalability and performance optimization for large-scale data processing.
• Experience in reliable pipeline execution with testing and validation of data outputs.
• Good to have experience with PySpark for distributed data transformations.

Education: B.E., B.Tech, M. Tech

Key Skills

Education

Any Graduate