Description

You will architect and build scalable big data solutions.

Responsibilities

• Architect and design scalable big data solutions leveraging Hadoop, Hive, Spark, and Scala.
• Develop and optimize data pipelines and workflows for processing and analyzing large-scale datasets.
• Manage and fine-tune distributed computing frameworks to ensure high performance and reliability.
• Collaborate with cross-functional teams to gather and define data requirements.
• Implement data security, governance, and compliance measures in big data environments.
• Diagnose and resolve technical issues in big data systems to maintain operational efficiency.

Required Skills

• 10+ years of experience in Big Data and Hadoop Ecosystems.
• In-depth knowledge of the Hadoop ecosystem, including HDFS and MapReduce.
• Expertise in Hive for data warehousing and querying large datasets.
• Strong experience with Apache Spark for distributed data processing and real-time analytics.
• Advanced proficiency in Scala programming for big data application development.
• Familiarity with ETL processes and data integration techniques.
• Strong SQL skills.
• Basic knowledge of Java and Springboot.

Key Skills

Education

Any Graduate