Description

Lead and architect complex data migration projects from end to end, ensuring data accuracy and integrity. Design and develop scalable data solutions using Azure services, including Azure Data Factory (ADF) and Synapse Data Warehouse. Implement data processing pipelines using Azure Functions and Python. Utilize Databricks and Spark for large-scale data processing tasks. Mentor junior engineers and enforce technical best practices across all projects.

Responsibilities

• Architect and execute end-to-end data migration projects.
• Design data solutions using Azure, ADF, and Synapse Data Warehouse.
• Implement data processes using Azure Functions and Python.
• Process large-scale data tasks using Databricks and Spark.
• Mentor junior engineers and enforce technical best practices.

Required Skills

• 5+ years of experience in data engineering.
• Deep expertise in Azure, Azure Data Factory (ADF), and Synapse Data Warehouse.
• Strong proficiency in Python and Azure Functions.
• Hands-on experience with Databricks and Spark.
• Proven track record of managing and executing data migration projects.
• Degree in Computer Science, Data Science, or a related field.

Preferred Skills

• Experience with PostgreSQL and AWS.
• Knowledge of AWS to Azure migration workflows.

Key Skills

Education

Any Graduate