Description

You will lead the design and implementation of scalable, secure data processing pipelines across the Azure ecosystem.

This role is on-site.

Responsibilities

• Design and implement scalable data processing pipelines using Azure Data Factory, Azure Databricks, and Synapse Analytics.
• Manage and optimize data storage across Azure Data Lake Storage, Azure SQL Data Warehouse, and Azure Cosmos DB.
• Automate data ingestion, processing, and distribution workflows to streamline operations.
• Monitor and troubleshoot data-related issues to maintain high availability and performance.
• Apply Dev-Ops practices, including CI/CD, to manage complex data modeling and large database environments.

Required Skills

• 10+ years of professional experience in data engineering.
• Expert-level proficiency with Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service.
• Expert-level SQL writing and optimization skills.
• Fluency with Big Data technologies, specifically Apache Spark and Apache Kafka.
• Proficiency in Python for data processing applications.
• Proven experience designing and building ETL/ELT solutions.
• Strong understanding of CI/CD practices and complex data modeling.

Preferred Skills

• Experience with Azure Cosmos DB and Azure SQL Data Warehouse.

Key Skills

Education

Any Graduate