Description

You will design and implement scalable data pipelines and warehousing solutions within the Microsoft Azure ecosystem.

Responsibilities

• Design and implement data pipelines using Azure Data Factory to ingest, transform, and integrate data from multiple sources.
• Develop and optimize data warehousing solutions using Azure Synapse Analytics and Synapse SQL Pool.
• Orchestrate end-to-end data workflows using Synapse Pipelines and monitor performance for reliability.
• Leverage Synapse Spark to develop and optimize Spark jobs for large-scale big data processing.
• Identify and resolve performance bottlenecks in SQL queries, Spark jobs, and data pipelines.

Required Skills

• 10+ years of professional experience in data engineering roles.
• Hands-on expertise with Azure Data Factory (ADF).
• Extensive experience with Azure Synapse Analytics.
• Proficiency with Azure Databricks.
• Experience managing Synapse Pipelines.
• Experience with Synapse Spark for big data processing.
• Deep knowledge of Synapse SQL Pool.
• Advanced proficiency in SQL and T-SQL.
• Bachelor’s Degree in Computer Science, Information Technology, or a related field.

Key Skills

Education

Bachelor’s Degree