Description

This role involves building and maintaining data pipelines while leading technical work.

Responsibilities

• Lead two team members by reviewing their code.
• Manage the CI/CD process for data systems.
• Interface with customers and upstream stakeholders.
• Build and maintain data pipelines, specializing in testing, validating, and deploying data systems for production readiness.
• Develop proofs of concept to validate solution feasibility and functionality.

Required Skills

• 5+ years of experience as a Senior Data Engineer.
• Experience with the Big Data Ecosystem, specifically Spark and Scala.
• Proficiency with Apache Hive for data warehousing.
• Strong experience with SQL.
• Experience building and maintaining data-driven projects, such as the Customer Status Qualifier.
• Familiarity with data validation and deployment workflows.

Preferred Skills

• Lead experience is a plus.
• AWS experience.

Key Skills

Education

Any Graduate