Description

You will design and automate end-to-end ETL workflows using Azure Data Factory, Databricks, and core Azure Cloud services. You own the data movement pipeline, ensuring high performance through seamless integration with Azure Blob Storage and ADLS.

Responsibilities

• Design ADF pipelines to automate ETL workflows and optimize data movement.
• Develop data solutions in Databricks using PySpark, Spark SQL, and Delta Lake.
• Implement secure data handling using Azure Logic Apps and Key Vault.
• Apply data modeling and warehousing concepts to support business needs.
• Perform SQL performance tuning and work within Agile/Scrum frameworks.

Required Skills

• 5+ years of hands-on experience with Azure Data Factory (ADF).
• Deep expertise in Databricks, PySpark, Spark SQL, and Delta Lake.
• Strong knowledge of Azure Blob Storage and Azure Data Lake Storage (ADLS).
• Proficient in SQL with a focus on performance tuning.
• Experience with Azure Logic Apps and Key Vault.
• Ability to design solutions independently with minimal supervision.
• Working knowledge of Agile/Scrum methodologies.

Key Skills

Education

Any Graduate