Description

You will build and maintain data pipelines to support business intelligence and analytical requirements.

Responsibilities

• Build and manage data pipelines and workflows using Airflow.
• Monitor and support big data pipelines to ensure stability.
• Perform root cause analysis on internal and external data processes to resolve issues.
• Work with structured datasets to extract actionable insights.

Required Skills

• 5+ years of experience in data engineering roles.
• Proficiency in Python and PySpark for object-oriented scripting.
• Strong relational SQL skills for querying structured datasets.
• Experience with Azure Databricks and Azure Data Lake.
• Hands-on experience with Airflow for workflow management.
• Ability to perform deep-dive analysis on data processes.
• Experience supporting and monitoring large-scale data pipelines.

Preferred Skills

• Bachelor's degree or equivalent experience.

Key Skills

Education

Any Graduate