Description

You will develop and manage data processing pipelines within a big data environment.

Responsibilities

• Develop and optimize Spark Scala applications for large-scale data processing.
• Manage and troubleshoot data flows utilizing Hive, Impala, Kafka, and HBase.
• Implement and support data jobs across various SDLC phases, including testing and production deployment.
• Debug and trace complex errors and exceptions occurring during Spark job execution.

Required Skills

• 5+ years of professional experience in Big Data development.
• Expert proficiency in Spark Scala programming.
• Extensive experience with Hadoop Ecosystem and Spark Architecture.
• Proficiency in Unix Shell Scripting, PL/SQL, and Autosys scheduler.
• Strong working knowledge of Spark Streaming.
• Experience with tools including udeploy, TeamCity, and SharePoint.
• Demonstrated ability to work across the full Software Development Life Cycle (SDLC).

Key Skills

Education

Any Graduate