Description

You will build and maintain data processing applications and scalable pipelines for large-scale datasets.

Responsibilities

• Develop data processing applications using Apache Spark, Scala, and Python.
• Design and maintain scalable data pipelines to process large volumes of data.
• Perform data analysis and optimization to improve processing task performance.
• Translate business requirements into technical solutions through cross-functional collaboration.
• Troubleshoot and resolve issues regarding data quality and processing workflows.

Required Skills

• 5+ years of experience in data-driven roles.
• Proficiency in Apache Spark for big data processing and analytics.
• Strong programming skills in Scala for scalable application development.
• Advanced Python programming for data manipulation and analysis.
• Expertise in SQL and data analysis.
• Experience with tools and frameworks within the Apache Spark ecosystem.
• Understanding of distributed computing principles and parallel data processing.
• Degree in any graduate field.

Key Skills

Education

Any Graduate