Description

Develop and maintain large-scale data processing applications within the Hadoop ecosystem.

Responsibilities

• Develop and optimize data pipelines using Spark and Scala.
• Debug and trace errors or exceptions during Spark job execution.
• Manage scheduled workflows using Autosys and support all SDLC phases including testing and production deployment.
• Write and maintain Unix shell scripts and PL/SQL procedures.

Required Skills

• 3+ years of experience in big data development.
• Strong proficiency in Spark and Scala with deep understanding of Spark Architecture.
• Extensive experience with Hive, Impala, Kafka, and HBase.
• Practical knowledge of Spark Streaming.
• Experience with Unix Shell Scripting and PL/SQL.
• Proficiency with Autosys Scheduler, uDeploy, and TeamCity.
• Bachelor's degree.

Preferred Skills

• Experience using SharePoint for documentation.

Key Skills

Education

Bachelor's degree