Description

Design and manage data pipelines using Apache Airflow to support extraction and reporting.

Responsibilities

• Design and implement ETL jobs to automate data movement.
• Build, maintain, and orchestrate complex data workflows and pipelines.
• Optimize data for extraction and reporting use.
• Perform database management functions to oversee data loading operations.
• Ensure high performance during data retrieval processes.

Required Skills

• 3+ years of industry experience as an Apache Airflow developer.
• Proficiency in Apache Airflow development.
• Expertise in Python and its associated frameworks.
• Strong understanding of data warehouse concepts.
• Experience with ETL tools such as Informatica and Pentaho.
• Experience working in SQL environments.
• Experience with reporting tools like Power BI and Qlik.

Preferred Skills

• Familiarity with Apache Hadoop, HDFS, and Hive.
• Working knowledge of agile processes and methods.

Key Skills

Education

Bachelor's Degree