Description

Design and implement end-to-end data solutions within the Azure ecosystem. Own the architecture for batch and stream ingestion from RDBMS sources including SQL Server, Oracle, and MySQL. Build, tune, and optimize Spark-based data pipelines and cloud-native ETL processes using Azure Data Factory and Databricks. Performance tune Azure Synapse databases and Delta Lake structures. Collaborate with business and development teams to deliver data architectures following industry best practices.

Responsibilities

• Design and implement data solutions using Azure Data Factory, Databricks, and Azure Data Lake Storage.
• Build and tune data pipelines using Spark and cloud-native ETL tools.
• Optimize Azure Synapse databases and perform workload performance tuning.
• Develop batch and stream ingestion processes from SQL Server, Oracle, and MySQL.
• Collaborate with teams to deliver data architectures following industry best practices.

Required Skills

• 8+ years of experience in data engineering and Azure Cloud environments.
• Hands-on experience with Azure Data Factory and Azure Data Lake Storage.
• Proficiency in Databricks and Delta Lake.
• Strong programming skills in Python.
• Extensive experience with SQL Server and other RDBMS like Oracle and MySQL.
• Proven ability to design solutions on Hadoop and Azure Synapse.
• Experience building and tuning Spark-based data pipelines.
• Deep understanding of data engineering architectures across cloud providers and open-source tools.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Gradute