Description

You will design, develop, and optimize large-scale data pipelines and technical solutions.

This role is on-site.

Responsibilities

• Design and optimize large-scale data pipelines using PySpark and Python.
• Implement object-oriented programming methodologies to create reusable and maintainable code.
• Write advanced SQL queries for complex ETL processes.
• Collaborate with data scientists and analysts to translate requirements into technical implementations.
• Troubleshoot data-related issues and perform performance tuning on data jobs.

Required Skills

• 5+ years of hands-on experience with PySpark and Python.
• Expertise in crafting and implementing scalable data transformations.
• Solid understanding of Object-Oriented Programming (OOP) principles and design patterns.
• Proficiency in SQL, including writing complex queries and optimizing performance.
• Experience with AWS cloud services such as S3, EMR, Lambda, and Glue.
• Strong problem-solving skills for independent troubleshooting of complex data issues.
• Any Graduate degree.

Preferred Skills

• Familiarity with Git, CI/CD pipelines, and Agile methodologies.
• Exposure to data warehousing, distributed computing, and performance tuning.

Key Skills

Education

Any Graduate