Description

You will develop and maintain data pipelines using PySpark and ETL processes.

Responsibilities

• Develop and optimize ETL workflows to ensure efficient data processing.
• Implement data transformation logic using PySpark.
• Maintain existing data pipelines and troubleshoot processing issues.

Required Skills

• 10+ years of experience in data engineering or related roles.
• Expertise in PySpark for large-scale data processing.
• Proven experience building and managing ETL pipelines.
• Ability to work onsite in the NY office 1-2 days per week.
• Bachelor's degree or equivalent graduate-level education.

Key Skills

Education

ANY GRADUATE