Description

You will build and maintain large-scale data processing pipelines.

This role is on-site.

Responsibilities

• Develop and optimize data processing jobs using Spark SQL and streaming.
• Manage and scale data infrastructure on AWS, GCP, or Azure.
• Engineer data ingestion and storage solutions utilizing Hadoop, Elasticsearch, and Cassandra.
• Maintain and improve existing big data systems.

Required Skills

• 9+ years of professional experience in Big Data engineering.
• Expert proficiency in Spark SQL and Spark Streaming.
• Strong experience with the Hadoop ecosystem.
• Proficiency in Java or Python for data processing logic.
• Hands-on experience with at least one cloud provider: AWS, GCP, or Azure.
• Experience implementing solutions using Elasticsearch and Cassandra.

Preferred Skills

• Experience with multiple cloud providers.
• Advanced tuning of Spark jobs for performance.

Key Skills

Education

Any Graduate