Description

You will design, develop, and optimize scalable data processing solutions using Spark and Python.

Responsibilities

• Design, develop, and optimize high-performance data processing applications leveraging Apache Spark.
• Write clean, reusable, and efficient Python code for data engineering initiatives.
• Analyze complex datasets to extract actionable insights and identify trends.
• Collaborate with stakeholders to gather requirements and deliver tailored data solutions.
• Manage deployment and continuously monitor the health and performance of data pipelines in production.

Required Skills

• 5+ years of experience in Big Data development.
• Expert proficiency in Apache Spark.
• Strong command of Python.
• Experience with Big Data Hadoop Ecosystem.
• Proficiency in Sparksql.
• Familiarity with Scala.
• Ability to implement efficient data transformations and aggregations.

Key Skills

Education

Any Gradute