Description

You will build large-scale batch and real-time data pipelines on Azure, using Azure Databricks for high-performance ingestion and scalable framework development.

Responsibilities

• Design and implement performant data ingestion pipelines from multiple sources using Azure Databricks.
• Lead ETL process design, data integration, and migration strategies.
• Develop scalable, reusable frameworks for dataset ingestion to ensure efficiency and reliability.
• Partner with architects and engineers to deploy enterprise-grade data solutions.

Required Skills

• 5+ years of experience with Azure Databricks and Azure Data Lake Storage (ADLS).
• Hands-on experience with Azure Data Factory, Azure Data Analytics, and Azure Data Lake.
• Proficiency in Azure SQL Database and Data Warehouse solutions.
• Strong SQL skills in T-SQL and PL/SQL, including performance tuning and optimization.
• Experience designing and deploying data applications on Azure cloud infrastructure.
• Familiarity with Agile environments, Jira, and project delivery methodologies.

Preferred Skills

• Experience working in collaborative teams with stakeholders and analysts.

Key Skills

Education

Any Graduate