Description

You will design and build scalable data pipelines for the data platforms.

This role is on-site.

Responsibilities

• Develop and optimize ETL processes using distributed computing frameworks.
• Implement data models for structured and semi-structured data sources.
• Ensure data quality through rigorous debugging and performance tuning.
• Contribute to the development lifecycle using Agile methodologies.

Required Skills

• 5+ years of experience in data engineering or software development.
• Strong, hands-on experience with Apache Spark and PySpark.
• Proficiency in Python for data manipulation and error handling.
• Solid understanding of distributed computing concepts (RDDs, DataFrames, partitions, shuffles).
• Proficiency in SQL and data modeling.
• Experience with version control (Git), CI/CD, and Agile practices.
• Proven skills in debugging and performance tuning.

Key Skills

Education

Any Graduate