Description

You will design and implement big data solutions leveraging distributed systems.

Responsibilities

• Process and optimize data using Hive SQL and Spark.
• Build and maintain data pipelines utilizing Hadoop and Kafka.
• Design data architecture solutions for large-scale data sets.
• Implement streaming data processing using relevant frameworks.

Required Skills

• 5+ years of experience in data engineering.
• Expert proficiency in Scala and Spark.
• Strong command of Hive SQL and Hadoop ecosystems.
• Experience with Kafka for data streaming.
• Knowledge of Data Architecture principles.
• Familiarity with data partitioning, compression, and serialization formats.

Preferred Skills

Key Skills

Education

Any Gradute