Description

You design and manage data integration pipelines for the CIMS Data Warehouse and Data Lake on Azure.

This role is on-site.

Responsibilities

• Design and develop high-performing ETL processes to integrate and transform data from disparate sources.
• Build and manage complex ETL workflows, ensuring data is accurate, timely, and secure for downstream analytics.
• Leverage the Azure ecosystem (ADF, Databricks, Synapse, Purview) to process high volumes of structured and unstructured data.
• Optimize ETL jobs continuously to minimize latency and maximize throughput across the data architecture.
• Embed security and compliance best practices into every stage of the ETL process.

Required Skills

• 7+ years of experience in ETL development and data engineering.
• 3+ years of hands-on experience with ADF, Azure Cloud, Azure Databricks, Azure Synapse Analytics, and Azure Purview.
• Extensive expertise in Spark, Python, and/or Scala for large-scale data transformations.
• Strong proficiency in SQL and experience handling complex data structures.
• Proven track record building and optimizing large-scale ETL pipelines for high-availability environments.
• In-depth knowledge of data governance, security protocols, and RBAC within Azure.
• Experience with ETL processes and data validation.
• Familiarity with Power BI for reporting needs.

Preferred Skills

• Experience with unstructured data processing at scale.

Key Skills

Education

Any Graduate