Description

You will build and manage scalable data processing workflows and ETL pipelines.

This role is on-site.

Responsibilities

• Design, develop, and maintain data processing workflows using PySpark and Python.
• Optimize and fine-tune Spark applications for performance and resource efficiency.
• Develop ETL processes for data extraction, transformation, and loading.
• Work with large-scale distributed systems to process and analyze big data sets.
• Implement data quality and validation measures to ensure accuracy and reliability.

Required Skills

• 6+ years of experience in data engineering.
• Proficiency in PySpark or JavaSpark.
• Strong experience with Python.
• Advanced SQL skills.
• Hands-on experience with ETL processes for data extraction and transformation.
• Experience working with large-scale distributed systems.

Key Skills

Education

Any Graduate