Description

You will design, develop, and maintain scalable data pipelines and cloud-based data solutions on Microsoft Azure.

This role is on-site.

Responsibilities

• Design and build ETL/ELT solutions using Azure Data Factory and related Azure services.
• Develop and optimize batch and streaming data processing pipelines using Databricks or Apache Spark.
• Integrate data from internal and external systems into Azure data platforms.
• Write complex SQL queries for data transformation, validation, and analysis.
• Troubleshoot pipeline issues, perform root cause analysis, and ensure performance and reliability.

Required Skills

• 5+ years of experience with Microsoft Azure cloud-native technologies.
• 2+ years building ETL/data pipelines using Azure Data Factory, Event Hubs, Event Grid, Azure Functions, Databricks, or Apache Spark.
• Experience with Azure Cosmos DB, Azure SQL, Azure Synapse, and Azure Cache for Redis.
• Strong Python or Java programming and SQL skills.
• Experience with Airflow or Oozie for workflow orchestration.
• Knowledge of CI/CD, SDLC, security best practices, and coding standards.
• Experience with batch and streaming data pipelines and Agile development.

Key Skills

Education

Any Graduate