Description

Design, build, and maintain scalable data pipelines and cloud-based solutions for enterprise banking reporting.

This role is on-site.

Responsibilities

• Design and develop scalable data pipelines using Azure Databricks, Azure Data Factory, ADLS, and Synapse Analytics.
• Lead data migration initiatives from on-premises databases to Azure, ensuring data quality and integrity.
• Optimize data processing frameworks using Python, SQL, and distributed processing technologies.
• Build and manage Azure Databricks services for data ingestion, transformation, and integration with Snowflake.
• Troubleshoot performance issues and implement best practices for cloud data engineering scalability.

Required Skills

• 10+ years of experience in Data Engineering and Cloud Data Platforms.
• Strong expertise in Azure Databricks, Azure Data Factory (ADF), and Azure Data Lake Storage (ADLS).
• Proficiency in Azure Synapse Analytics, SQL, and Python for large-scale data solutions.
• Proven experience migrating on-premises data to Azure Cloud.
• Experience working with Databricks features including DBFS, DataFrames, and RDDs.
• Ability to integrate data with Snowflake and other Azure-based platforms.
• Bachelor’s degree in Computer Science, IT, Data Engineering, Software Engineering, or related field.

Key Skills

Education

Any Graduate