Description

You will build and maintain high-performance data pipelines for the enterprise Data Warehouse, enabling analytical capabilities for business users.

This role is on-site.

Responsibilities

• Develop secure, scalable data pipelines using Spark and Java/Scala on object storage and Hadoop.
• Manage production incidents independently, performing root cause analysis and implementing mitigation plans.
• Identify emerging issues and recommend technical solutions to meet project deadlines.
• Provide technical leadership to junior team members and contribute to process efficiency improvements.
• Perform proof-of-concepts (POCs) to explore solutions for complex problem statements.

Required Skills

• 7 to 9 years of experience in Data Engineering and implementing end-to-end DW projects in Big Data environments.
• Proficiency with Spark using Java or Scala on Hadoop or Object storage.
• Strong SQL knowledge and experience with databases such as Oracle and Netezza.
• Proficiency in Python.
• Experience working with APIs.
• Experience working within Unix environments and Agile teams.
• Strong analytical skills for debugging production issues.

Preferred Skills

• Experience working with NiFi.

Key Skills

Education

ANY GRADUATE