Description

Design and implement full-scale data warehouse solutions from the ground up.

Responsibilities

• Architect scalable data warehouse solutions for complex requirements.
• Develop and maintain high-performance data processing pipelines using Spark and Scala.
• Resolve ambiguous technical challenges through rigorous problem-solving.
• Communicate technical designs, trade-offs, and progress clearly to stakeholders.

Required Skills

• 10+ years of experience designing and implementing full-scale data warehouse solutions.
• 6+ years of hands-on development experience using Spark and Scala.
• Proficiency with PySpark and Python for data manipulation and processing.
• Experience with Big Data databases, specifically HBase.
• Strong architectural design and complex problem-solving capabilities.
• Bachelor's degree in Computer Science or related field.
• Effective oral and written communication skills.

Preferred Skills

• Experience with AWS cloud services.
• Knowledge of Airflow and Hive.

Key Skills

Education

Bachelor's degree