Description

You will build and manage large-scale data processing systems and pipelines.

This role is on-site.

Responsibilities

• Design and develop big data pipelines using Hadoop and PySpark.
• Write and optimize complex Hive and SQL queries for large-scale data processing.
• Monitor and troubleshoot data workflows to ensure performance and reliability.
• Maintain data integrity and consistency throughout the data lifecycle.
• Implement practices for data governance, security, and compliance.

Required Skills

• 5+ years of experience in big data engineering.
• Hands-on experience with the Hadoop ecosystem, including HDFS, YARN, and MapReduce.
• Proficiency in PySpark for distributed data processing.
• Expertise in Hive for querying large datasets.
• Strong SQL skills for data manipulation and optimization.
• Ability to collaborate with data scientists and analysts to deliver technical solutions.
• Any Graduate degree.

Key Skills

Education

Any Graduate