Description

You will build high-performance data pipelines to load data into the enterprise Data Warehouse to provide analytical capabilities for business users.

Responsibilities

• Develop secure, scalable data pipelines using Spark and Java/Scala on object storage and Hadoop.
• Follow established quality assurance and quality control processes.
• Identify emerging issues and recommend technical solutions to meet project deadlines.
• Manage production incidents independently and perform root cause analysis.
• Provide technical leadership to junior team members and contribute to process efficiency improvements.

Required Skills

• 7 to 9 years of experience in Data Engineering and implementing end-to-end DW projects in Big Data environments.
• Proficiency with Spark using Java or Scala on Hadoop or Object storage.
• Strong SQL knowledge and experience with databases such as Oracle and Netezza.
• Experience working within Unix environments and Agile teams.
• Strong analytical skills for debugging production issues and implementing mitigation plans.
• Ability to perform POCs to explore solutions for complex problem statements.
• Experience with APIs.
• Proficiency in Python.

Preferred Skills

• Experience working with NiFi.

Key Skills

Education

ANY GRADUATE