Description

You own the monitoring, support, and development of data pipelines across Azure and Snowflake, ensuring execution reliability and rapid incident resolution.

This role is hybrid.

Responsibilities

• Monitor and respond to alert emails for execution failures in Databricks, Azure Data Factory, and data quality gap reports.
• Proactively address user questions on Zoom channels, capture issues, and implement necessary fixes.
• Investigate break-in issues, analyze missing data, and remediate jobs or pipelines that fail to run on schedule.
• Design, support, and develop batch and streaming pipelines using Azure cloud services and Snowflake.

Required Skills

• 8+ years of IT experience with pipeline design, support, and development.
• Advanced proficiency in Python and Spark.
• Strong understanding of ETL/ELT processes in Databricks and Azure Data Factory.
• Experience connecting with third-party systems, APIs, Event Hubs, and Snowflake.
• Demonstrated knowledge of Azure cloud storage, security, and resource optimization.
• Excellent assertive communication skills in English.
• Understanding of Agile methodologies.

Preferred Skills

• Experience with Git-based version control (GitHub, GitLab, Bitbucket) including branching strategies and code reviews.
• Focus on proactive detection and fast reactive maintenance of running jobs and pipelines.

Key Skills

Education

Bachelor's degree