Description

You will lead the design and development of scalable data processing solutions using Java and Apache Spark.

Responsibilities

• Design and develop scalable data processing solutions using Java and Apache Spark.
• Optimize Spark jobs for performance and scalability in distributed environments.
• Collaborate with data architects and stakeholders to define data requirements.
• Ensure code quality through code reviews and unit testing.
• Troubleshoot and resolve technical issues across the data pipeline.

Required Skills

• 5+ years of experience in relevant engineering roles.
• Proficiency in Java and building optimized Spark jobs.
• Experience with Kafka, Hive, Docker, and Kubernetes.
• Familiarity with cloud platforms including AWS, Azure, and GCP.
• Experience implementing CI/CD pipelines and using Git for version control.
• Strong understanding of distributed computing and big data concepts.
• Excellent problem-solving and communication skills.

Preferred Skills

• Knowledge of Python or Scala.
• Experience with Hadoop ecosystem tools.

Key Skills

Education

Any Gradute