Description

You will design and maintain ETL pipelines and data assets on Azure using Databricks, ensuring data accuracy across cloud migration.

This role is hybrid.

Responsibilities

• Design and develop ETL flows and data assets using Databricks, Python, and SQL.
• Perform data validation and cross-checking across sources to ensure accuracy and consistency.
• Validate ETL pipelines and business logic for correct transformation and loading into the cloud data platform.
• Assist in the design of a summary data layer and other key data assets.
• Collaborate with business analysts to translate data requirements into technical solutions.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency in Databricks, Python, and SQL for data manipulation and ETL development.
• Experience designing and implementing ETL processes.
• Knowledge of Azure cloud-based data platforms.
• Proven experience in data validation and data quality assurance.
• Strong analytical skills to identify and resolve data discrepancies.
• Familiarity with data governance principles and best practices.

Key Skills

Education

Any Gradute