Description

You will build and maintain ETL pipelines for large-scale data processing, focusing on big data ingestion, transformation, and feature engineering.

Responsibilities

• Build and maintain ETL pipelines for large-scale data processing.
• Execute feature engineering tasks to support downstream requirements.
• Manage data processing workflows using distributed frameworks.
• Handle big data ingestion and transformation tasks.

Required Skills

• 5+ years of professional experience in data engineering or related roles.
• Proficiency with Pandas for data manipulation.
• Experience with PyArrow for efficient data processing.
• Hands-on expertise with PySpark for distributed computing.
• Strong understanding of Big Data Processing techniques.
• Proven experience building and managing ETL processes.
• Bachelor's degree or equivalent experience.

Preferred Skills

• Experience with cloud-based data platforms.

Key Skills

Education

Any Graduate