Description

You will design, implement, and maintain data pipelines within the Azure ecosystem.

This role is on-site.

Responsibilities

• Design and implement ETL/ELT processes using Azure services.
• Troubleshoot pipeline failures, cluster issues, and performance bottlenecks.
• Perform data mapping, profiling, and system requirements documentation.
• Utilize data warehousing concepts (EDW/BDW) for data management.

Required Skills

• 8+ years of experience as a Data Analyst.
• Proficiency with Azure Data Factory, Databricks, ADLS, and Azure SQL.
• Hands-on experience with Databricks notebooks, PySpark, and Spark SQL.
• Strong knowledge of ETL/ELT concepts and data ingestion patterns.
• Experience with Azure DevOps and Git version control for CI/CD pipelines.
• Proficiency in SQL and Python (including Pandas data frames).
• Familiarity with Delta Lake and data warehousing principles.
• Experience working within the insurance domain.

Key Skills

Education

Any Gradute