Description

Lead the design and optimization of data architectures within the Azure ecosystem.

Responsibilities

• Design and implement end-to-end data solutions using Azure Data Factory, Databricks, and Delta Lake.
• Optimize Azure Synapse database performance and tune workloads to resolve existing pipeline issues.
• Build and tune data pipelines for both batch and stream ingestion from RDBMS sources including SQLServer, Oracle, and MySQL.
• Collaborate with business and development teams to deliver data architectures following industry best practices.
• Evaluate various data engineering tools and architectures across cloud providers and open-source packages.

Required Skills

• 15+ years of overall professional experience.
• 8+ years of experience with Azure Data pipelines, Azure Data Factory, and Azure Data Lake Storage.
• Deep expertise in Databricks, Delta Lake, and Python.
• Strong experience designing solutions on Azure Synapse, Hadoop, SQLServer, and Oracle.
• Hands-on experience with Spark-based data pipeline tuning and ETL tools.
• Proven ability to manage data ingestion from SQLServer, Oracle, MySQL, and other RDBMS.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate