Description

You will lead the design and development of ETL pipelines for big data and relational databases.

Responsibilities

• Design and develop ETL pipelines using Azure Data Factory for data ingestion and transformation.
• Build data solutions by integrating Azure Data Lake and SQL DW modules.
• Write SQL, Python, and PySpark code to handle efficient data processing.
• Translate business requirements into technical designs, mapping documents, and transformation rules.
• Communicate project status and technical progress to stakeholders.

Required Skills

• 10-12 years of experience in data ingestion, processing, and analytical pipelines.
• Hands-on expertise with Azure Databricks and Azure Data Factory.
• Proficiency in PySpark, Python, and Advanced SQL.
• Experience with Azure Data Lake (ADLS) and Azure Synapse.
• Experience with Azure SQL DB.
• Familiarity with DevOps and CI/CD deployment workflows.
• Ability to work in high-pressure environments with strong attention to detail.

Preferred Skills

• Experience working within the insurance or financial industry.

Key Skills

Education

Any Graduate