Description

You will develop and maintain data pipelines using Azure data services.

Responsibilities

• Create ETL pipelines using Azure Data Factory and sequence Data Bricks jobs within ADF.
• Develop reusable notebooks in Azure Data Bricks, utilizing functions and parameters.
• Implement ETL logic, including full and incremental loads, using Data Bricks and ADF pipelines.
• Perform data migration and conversion projects.
• Troubleshoot defects and resolve issues within data processing workflows.

Required Skills

• 10+ years of professional experience in ETL development.
• Expertise with Azure Data Factory and Data Bricks.
• Strong proficiency in Python and PySpark.
• Advanced SQL skills, including CTEs, ANSI SQL, and set operators (minus, except, union).
• Experience writing PL/SQL blocks, triggers, and managing indexes in Oracle.
• Proficiency in querying and tuning performance for Oracle and SQL Server databases.
• Working knowledge of core ETL concepts (full load, incremental load).
• Experience with Oracle and SQL Server database environments.

Key Skills

Education

Any Graduate