Description

Design and develop scalable data warehouse solutions, ETL/ELT processes, and workflow orchestration pipelines.

This role is on-site.

Responsibilities

• Develop ETL and ELT processes using SQL, Oracle, Apache Spark Data Lake, and Delta Lake.
• Write and maintain Python code using PySpark for Delta Lake management and queries.
• Build and manage Apache Airflow DAGs for workflow orchestration.
• Execute data mapping and analytics tasks to support business requirements.
• Design and develop scalable data warehouse solutions.

Required Skills

• 5+ years of experience in BI development.
• Expertise in data warehouse design and development.
• Proficiency in Python, specifically PySpark.
• Strong T-SQL and SQL skills.
• Experience with Apache Spark and Spark ETL/ELT development.
• Experience developing Airflow DAGs.
• Hands-on work with Microsoft SQL Server.
• Knowledge of Azure and AWS cloud technologies.

Preferred Skills

• Experience working with Oracle databases.
• Direct experience managing Spark Data Lake and Delta Lake environments.

Key Skills

Education

ANY GRADUATE