Description

Manage and scale the core data pipeline to handle rapid data growth.

Responsibilities

• Own the core data pipeline and scale processing flows to meet increasing data volumes.
• Develop tools to support self-service ETL and data pipeline management.
• Tune SQL and MapReduce jobs to improve data processing performance.
• Evolve data models and schemas to align with business and engineering requirements.
• Implement systems to track data quality and consistency.

Required Skills

• 5+ years of professional experience.
• Strong Python coding proficiency.
• Advanced SQL skills.
• Experience with MapReduce job tuning.
• Knowledge of Java.
• Knowledge of C++.
• Bachelor's degree in Computer Science.

Preferred Skills

• Experience with large-scale data processing frameworks.
• Background in data modeling and schema design.

Key Skills

Education

Bachelor's degree in Computer Science