Description

You will manage and support data pipelines within an Azure environment.

Responsibilities

• Develop and maintain data workflows using Azure Data Factory.
• Analyze logs and job failures to troubleshoot and resolve script issues.
• Perform production support for ADF pipelines.
• Query databases to conduct data analysis and audit code logic.
• Collaborate within Agile methodologies and manage tasks through ServiceNow.

Required Skills

• 15+ years of industry experience.
• Hands-on experience with Azure Data Factory.
• Proficiency in Databricks and PySpark.
• Experience with SparkSQL.
• Ability to analyze logs and troubleshoot job failures.
• Experience with ServiceNow tools.
• Working knowledge of Agile methodologies.
• Degree in any graduate field.

Key Skills

Education

Any Gradute