Description

You will design and maintain scalable data platforms, pipelines, and API integrations to handle increasing data complexity.

Responsibilities

• Develop long-term data platform architecture strategy in collaboration with engineering and business units.
• Build and maintain scalable databases, data pipelines, and new API integrations.
• Design data models and data jobs using Spark, SparkSQL, and HiveSQL to populate company data assets.
• Implement monitoring processes and data quality frameworks to ensure accuracy and availability.
• Perform data analysis to troubleshoot issues and write unit/integration tests for all production code.

Required Skills

• 4+ years of SQL experience.
• 4+ years of experience with schema design and dimensional data modeling.
• 4+ years of Python or Java development experience.
• Experience designing, building, and maintaining data processing systems.
• Experience working with MapReduce or an MPP system.
• Experience developing with infrastructure as code such as Terraform or Bicep.
• Proficiency with Spark, SparkSQL, and HiveSQL.
• Knowledge of Agile Software Development methodologies.

Preferred Skills

• No-SQL experience.

Key Skills

Education

Bachelor's degree