Description

You will develop and optimize scalable data processing solutions in the Python Data domain.

Responsibilities

• Design, develop, and optimize high-performance data processing applications leveraging Apache Spark.
• Write clean, reusable, and efficient Python code for data engineering initiatives.
• Analyze complex datasets to extract actionable insights and identify trends.
• Collaborate with stakeholders to gather requirements and deliver tailored data solutions.
• Manage the deployment and continuous monitoring of data pipelines in production.

Required Skills

• Apache Spark
• Python
• 7 to 9 years of experience in data processing
• Designing and optimizing scalable data pipelines
• Implementing efficient data transformations and aggregations
• Troubleshooting data processing jobs for reliability
• Experience with large and complex datasets

Key Skills

Education

Bachelor's degree