Description

Build and optimize ETL pipelines on Azure Databricks for BFSI analytics.

This role is remote.

Responsibilities

• Develop and maintain scalable ETL pipelines using Azure Databricks, Apache Spark, and Python.
• Design data processing workflows to support analytics and reporting for financial products.
• Implement data quality checks, validation frameworks, and monitoring aligned with regulatory standards.
• Integrate data from legacy systems, cloud platforms, and third-party APIs.
• Resolve performance bottlenecks and contribute to CI/CD automation practices.

Required Skills

• 5+ years of experience in data engineering and big data technologies.
• Strong hands-on experience with Azure Databricks and Apache Spark.
• Proficiency in Python for data processing and pipeline development.
• Experience designing and implementing ETL/data pipelines at scale.
• Knowledge of data modeling, data warehousing, and distributed systems.
• Experience working with cloud platforms, preferably Azure.
• Familiarity with CI/CD pipelines and DevOps practices.

Preferred Skills

• Experience in the BFSI domain with understanding of regulatory/data governance requirements.

Key Skills

Education

Any Graduate