Description

You will design and maintain data integration solutions using Azure Data Factory and Databricks.

This role is on-site.

Responsibilities

• Design and build ETL pipelines using Azure Data Factory.
• Sequence Databricks jobs within ADF and create reusable notebooks with functions and parameters.
• Develop complex SQL queries utilizing CTEs, ANSI SQL, and Oracle functions, managing set operators like minus, except, and union.
• Create and tune PL/SQL blocks, triggers, and indexes in Oracle environments.
• Troubleshoot defects and optimize query performance using knowledge of indexes and partitioning.

Required Skills

• 7+ years of experience in ETL development.
• Proficiency with Azure Data Factory and Databricks.
• Expertise in Python and PySpark for data processing.
• Strong SQL skills, including advanced querying and set operators.
• Deep knowledge of Oracle database structures and PL/SQL development.
• Experience with data migration and conversion projects.
• Ability to perform query performance tuning.
• Demonstrated ability in troubleshooting and defect resolution.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate