Description

You will build and maintain large-scale data processing applications using the Spark ecosystem.

Responsibilities

• Build Spark applications using Scala for large-scale data processing.
• Develop and optimize data pipelines using Spark SQL and related libraries.
• Work within an agile environment to deliver technical solutions in cross-functional teams.
• Manage code and deployments through CI/CD pipelines.

Required Skills

• 6 to 9 years of professional software development experience.
• Hands-on experience with Apache Spark and Scala.
• Proficiency with Spark SQL and the Spark ecosystem.
• Experience with Java programming.
• Knowledge of Big Data technologies including Hadoop and HDFS.
• Experience with distributed computing frameworks.
• Practical use of Git, BitBucket, Gradle, or Jenkins for CI/CD.
• Familiarity with Jira and Confluence for project tracking.
• Proven experience working in agile environments.

Preferred Skills

• Experience with distributed computing at scale.

Key Skills

Education

Any Graduate