Description

You will design, build, and maintain scalable data infrastructure and products within the Azure ecosystem.

This role is on-site.

Responsibilities

• Design and implement large-scale distributed data solutions on Azure, including data distribution, partitioning, and cost management.
• Develop data processing pipelines using Spark (batch and real-time) and configure Delta Lake on Azure Databricks.
• Manage CI/CD pipelines using Azure DevOps for source control and automated releases.
• Ensure high availability, disaster recovery, and scalability for data services like Azure SQL DB, Synapse, and SQL Pools.
• Lead data track delivery with customer stakeholders, influencing large organizations through technical expertise.

Required Skills

• 8+ years of experience designing and productionizing data infrastructure.
• Deep hands-on experience with Azure Databricks, Spark, Delta Lake, and PySpark.
• Proficiency in SQL, Python, and PySpark for data processing.
• Must-have experience with Azure Data Factory, Azure Data Lake, Azure SQL DB, Synapse, and SQL Pools.
• Experience implementing CI/CD pipelines using Azure DevOps or similar tools.
• Strong understanding of data distributions, partitions, and cost optimization in Azure.
• Bachelor's degree in Computer Science or related field.

Preferred Skills

• Proven track record of customer management and leading delivery for data tracks.
• Experience documenting and maintaining reliable data products in complex environments.

Key Skills

Education

Bachelor's degree