Description

You will build high-performance data pipelines to load data into the enterprise Data Warehouse, providing analytical capabilities for business users.

Responsibilities

• Develop secure, scalable data pipelines using Spark and Java/Scala on object storage and Hadoop.
• Manage production incidents independently and perform root cause analysis.
• Identify emerging issues and recommend technical solutions to meet project deadlines.
• Provide technical leadership to junior team members and contribute to process efficiency improvements.
• Perform POCs to explore solutions for complex problem statements.

Required Skills

• 7 to 9 years of experience in Data Engineering and implementing end-to-end DW projects in Big Data environments.
• Proficiency with Spark using Java or Scala on Hadoop or Object storage.
• Strong SQL knowledge and experience with databases such as Oracle and Netezza.
• Proficiency in Python.
• Experience working with APIs.
• Experience working within Unix environments and Agile teams.
• Strong analytical skills for debugging production issues and implementing mitigation plans.

Preferred Skills

• Experience working with NiFi.

Key Skills

Education

ANY GRADUATE