Description

You will design and implement data pipelines and storage solutions within the Azure ecosystem.

Responsibilities

• Design and implement Azure Data Factory and Synapse pipelines.
• Develop Spark applications using Databricks and Synapse Notebooks.
• Build and manage staging and business layers using Delta Lake.
• Integrate Kafka streaming with Spark and other persistence services.
• Implement CI/CD processes for data warehouse development using Azure DevOps.

Required Skills

• 5+ years of professional experience.
• Practical experience with Spark, Spark SQL, and MPP flows.
• Hands-on development with Azure Data Factory and Azure Synapse.
• Proficiency in SQL and T-SQL for RDBMS environments.
• Experience with Databricks and Delta Lake architectures.
• Knowledge of Kafka and streaming integration.
• Working knowledge of Git, GitLab, and Jira.
• Experience with Azure DevOps and CI/CD automation.
• Competency in data modelling and structural design.

Preferred Skills

• Experience managing non-functional requirements including performance, storage consumption, and cost.

Key Skills

Education

Any Graduate