Description

Lead data pipeline development and team technical direction in a senior engineering capacity.

This role is on-site.

Responsibilities

• Own end-to-end data pipeline development from ingestion through transformation across bronze, silver, and gold layers.
• Build and maintain scalable data pipelines using AWS Glue and PySpark to convert raw data into analytics-ready formats.
• Collaborate with the Data Architect to implement data models and enforce data integrity standards.
• Provide technical guidance and oversight to Data Engineers and Analysts, ensuring adherence to engineering best practices.
• Monitor, optimize, and tune ETL processes and data workflows for efficient resource utilization.

Required Skills

• 7+ years of experience in data engineering.
• Proficiency with AWS Glue and PySpark for large-scale data processing.
• Strong SQL skills for data manipulation and querying.
• Experience leading data engineering teams and providing technical mentorship.
• Expertise in data pipeline development and ETL workflow optimization.
• Bachelor's degree in Computer Science, Engineering, or a related field.

Key Skills

Education

Bachelor's Degree