Description

You will build, maintain, and debug high-performance data pipelines for a centralized data warehouse.

This role is on-site.

Responsibilities

• Develop secure, scalable data pipelines using Spark and Java/Scala on Hadoop or object storage.
• Perform production incident management and debugging independently.
• Follow quality assurance processes to ensure data integrity.
• Identify emerging issues and recommend technical solutions to meet project deadlines.
• Provide technical leadership to junior team members and improve process efficiency.

Required Skills

• 7+ years of experience in Data Engineering and end-to-end data warehouse projects.
• Proficiency with Spark and Hadoop ecosystems.
• Strong programming experience in Java or Scala.
• Advanced SQL knowledge and experience with Oracle and Netezza.
• Competency in Python for data analysis and benchmarking.
• Experience working within Unix environments.
• Strong analytical skills for root cause analysis and production debugging.

Preferred Skills

• Experience with NiFi.
• Experience working with APIs.

Key Skills

Education

Any Graduate