Build large-scale batch and real-time data pipelines utilizing data processing frameworks within the Azure cloud platform.
Design and implement highly performant data ingestion pipelines from multiple sources using Azure Databricks.
Develop scalable and reusable frameworks for dataset ingestion, ensuring efficiency and reliability.
Lead the design of ETL processes, data integration, and data migration strategies.
Partner with architects, engineers, analysts, and stakeholders to develop and deploy enterprise-grade data solutions that support data-driven decision-making.
What's Needed?
Experience working with ADLS, Azure Databricks, Azure SQL Database, and Data Warehouse solutions.
Hands-on experience implementing Azure cloud components such as Azure Data Factory, Azure Data Analytics, Azure Data Lake, and related services.
Proficiency in designing and deploying data applications on Azure cloud solutions.
Strong SQL skills, including T-SQL and PL/SQL, with experience in performance tuning and optimization.
Experience working in Agile environments, with familiarity in Jira and project delivery methodologies