Description

Build and maintain large-scale data processing systems and streaming pipelines.

Responsibilities

• Develop and optimize data processing workflows using Spark SQL and Spark streaming.
• Manage and maintain distributed data storage across Hadoop, Cassandra, and Elasticsearch.
• Implement data pipelines within cloud environments including AWS, GCP, or Azure.
• Write clean, scalable code in Java or Python to support big data architectures.

Required Skills

• 9+ years of experience in big data engineering.
• Proficiency with Spark SQL and Spark streaming.
• Hands-on experience with Hadoop ecosystems.
• Experience with at least one major cloud provider: AWS, GCP, or Azure.
• Strong programming skills in Java or Python.
• Experience working with Elasticsearch and Cassandra.
• Bachelor's degree or equivalent experience in any field.

Key Skills

Education

Any Graduate