Description

You will lead data engineering initiatives and oversee the migration from Azure Synapse to Databricks.

Responsibilities

• Design and implement data solutions using best practices and architecture standards.
• Build and tune data pipelines using Spark, Azure Data Factory, and Databricks.
• Optimize Azure Synapse database performance and tune workloads.
• Manage both batch and stream ingestion from RDBMS sources including SQLServer, Oracle, and MySQL.
• Collaborate with business and development teams to deliver technical designs.

Required Skills

• 8-10 years of experience in data engineering and Azure Cloud environments.
• Hands-on experience with Azure Data Factory, Azure Data Lake Storage, and Databricks.
• Proficiency in Python, SQL, and SQLServer.
• Experience with Delta Lake and Spark-based pipeline tuning.
• Expertise in designing solutions for Hadoop, SQLServer, Oracle, and Azure Synapse.
• Strong understanding of Data Modeling.
• Proven ability to architect data solutions across cloud providers and open-source tools.
• Bachelor's degree or equivalent experience.

Key Skills

Education

Any Graduate