Description

You will build and manage data orchestration and ETL pipelines within on-premise database environments.

Responsibilities

• Develop data orchestration and ETL pipelines using Apache Airflow.
• Implement workflow automation through custom Airflow scripting and development.
• Execute SQL-based data processing and complex transformations.
• Integrate data workflows with existing on-premise database systems.
• Collaborate with stakeholders within an agile software development life cycle.

Required Skills

• 7+ years of experience in Information Technology.
• 4+ years of professional experience with Apache Airflow, specifically DAG development.
• 4+ years of project experience using Python and SQL.
• Proficiency in Python for scripting, data transformation, and automation.
• Strong understanding of ETL concepts and pipeline automation.
• Bachelor’s degree or foreign equivalent from an accredited institution.
• Experience working in agile environments on system development and maintenance.

Preferred Skills

• Experience with AWS or Azure cloud platforms.
• Knowledge of Hadoop, Scala, Spark, or PySpark.
• Experience with PL/SQL procedures, Unix shell scripting, or building custom Airflow operators.

Key Skills

Education

Any Graduate