Description

You will build and maintain data pipelines using Azure data services.

This role is remote.

Responsibilities

• Create ETL pipelines using Azure Data Factory and sequence Databricks jobs.
• Develop reusable notebooks in Databricks, utilizing functions and parameters.
• Implement full and incremental load logic using Databricks and ADF pipelines.
• Perform data migration and conversion projects.
• Troubleshoot defects and resolve issues within data processing workflows.

Required Skills

• 10+ years of professional experience in ETL development.
• Expertise with Azure Data Factory and Databricks.
• Strong proficiency in Python and PySpark.
• Advanced SQL skills, including CTEs, ANSI SQL, and set operators (minus, except, union).
• Experience writing PL/SQL blocks, triggers, and managing indexes in Oracle.
• Proficiency in querying and tuning performance for Oracle and SQL Server databases.
• Working knowledge of core ETL concepts (full load, incremental load).

Preferred Skills

• Experience with Oracle and SQL Server database environments.

Key Skills

Education

Any Graduate