Description

Lead the design and optimization of data architectures within the Azure ecosystem.

You will own the end-to-end data solutions, from ingestion to storage and performance tuning.

Responsibilities

• Design and implement data solutions using Azure Data Factory, Databricks, and Delta Lake.
• Optimize Azure Synapse database performance and tune workloads to resolve pipeline issues.
• Build and tune batch and stream ingestion pipelines from RDBMS sources like SQLServer, Oracle, and MySQL.
• Collaborate with business and development teams to deliver industry-standard data architectures.
• Evaluate data engineering tools and architectures across cloud providers and open-source packages.

Required Skills

• 15+ years of overall professional experience.
• 8+ years with Azure Data pipelines, Azure Data Factory, and Azure Data Lake Storage.
• Deep expertise in Databricks, Delta Lake, and Python.
• Strong experience designing solutions on Azure Synapse, Hadoop, SQLServer, and Oracle.
• Hands-on experience with Spark-based data pipeline tuning and ETL tools.
• Proven ability to manage data ingestion from SQLServer, Oracle, MySQL, and other RDBMS.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate