Description

You will build and maintain ETL pipelines to process data across bronze, silver, and gold layers.

Responsibilities

• Build ETL pipelines using PySpark and AWS Glue.
• Manage data storage and retrieval in Amazon S3.
• Implement data cleansing, validation, and transformation processes.
• Optimize data workflows to improve processing times and resource utilization.
• Collaborate with senior engineers to align data models with architectural standards.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency in PySpark and SQL.
• Hands-on experience with AWS Glue and Amazon S3.
• Strong understanding of ETL processes and data warehousing concepts.
• Bachelor’s degree in Data Engineering, Computer Science, or related field.
• Experience with data analysis and ensuring analytics readiness.

Key Skills

Education

Bachelor's degree