Description

Required Skills: Data Analysis, Spark, Scala, Python, SQL
Job Description:
Responsibilities
1. Develop and implement data processing applications using apache spark, scala, and python.
2. Design and maintain scalable data pipelines to process large volumes of data efficiently.
3. Perform data analysis and optimization to enhance the performance of data processing tasks.
4. Collaborate with cross functional teams to understand business requirements and translate them into technical solutions.
5. Troubleshoot and resolve issues related to data processing and data quality.
6. Stay updated with the latest advancements in apache spark, scala, and python to continuously improve data processing capabilities.

Skill Requirements
1. Proficiency in apache spark for big data processing and analytics.
2. Strong programming skills in scala for developing scalable applications.
3. Advanced knowledge of python programming for data manipulation and analysis.
4. Experience with data processing frameworks and tools in the apache spark ecosystem.
5. Understanding of distributed computing principles and parallel data processing.
6. Excellent problem-solving skills and ability to work in a fast paced environment.
7. Strong communication skills and ability to collaborate effectively with team members

Key Skills

Education

Any Graduate