Description

You will build and manage large-scale data processing pipelines.

Responsibilities

• Develop and optimize data processing jobs using Spark SQL and Spark Streaming.
• Design and implement data persistence layers using Cassandra.
• Integrate data services utilizing Elastic Search for indexing and querying.
• Manage and operate big data infrastructure on AWS, GCP, or Azure.

Required Skills

• 10+ years of professional experience in data engineering.
• Expert proficiency in Spark SQL and Spark Streaming.
• Deep experience with Hadoop ecosystem technologies.
• Strong programming skills in Java or Python.
• Hands-on experience with AWS, GCP, or Azure cloud platforms.
• Proficiency with Elastic Search and Cassandra.

Key Skills

Education

Any Graduate