Description

You will design and implement end-to-end data architectures and solutions within the Azure ecosystem.

Responsibilities

• Design and implement data solutions using Azure Data Factory, Databricks, and Delta Lake.
• Build and tune data pipelines using Spark and cloud-native ETL tools.
• Optimize Azure Synapse databases and perform workload performance tuning.
• Manage batch and stream ingestion from RDBMS sources including SQLServer, Oracle, and MySQL.
• Lead the migration of data workloads from Azure Synapse to Databricks.

Required Skills

• 10+ years of experience in data engineering and architecture.
• Hands-on experience with Azure Data Factory, Azure Data Lake Storage, and Databricks.
• Proficiency in Python and SQL.
• Extensive experience with Azure Cloud services and Azure Synapse.
• Strong knowledge of Hadoop, SQLServer, Oracle, and Delta Lake.
• Experience managing RDBMS-based databases including MySQL and SQLServer.
• Proven ability to build and tune Spark-based data pipelines.
• Bachelor's degree or equivalent experience.

Preferred Skills

• Experience designing architectures across various cloud providers and open-source tools.

Key Skills

Education

Any Graduate