Description

You will build and manage large-scale data pipelines within a cloud environment.

Responsibilities

• Build and maintain multiple data pipelines to support data processing requirements.
• Manage data flow and orchestration using Airflow and Kafka.
• Develop data processing logic using Python and PySpark.
• Operate within large-scale data warehouses handling multiple terabytes of data.

Required Skills

• 5+ years of experience in data engineering roles.
• Proven experience building multiple data pipelines.
• Proficiency with Airflow.
• Experience with Kafka.
• Strong Python skills, specifically using PySpark.
• Hands-on experience with Cloud platforms.
• Experience working with large-scale data warehouses (multiple TBs).
• Bachelor's degree or equivalent experience.

Key Skills

Education

Any Graduate