Description

Job Description

Key Responsibilities

• Design, develop, and maintain robust batch and real-time ETL/ELT pipelines across enterprise cloud ecosystems.
• Build and manage event-driven data streaming solutions using Apache Kafka (Producers, Consumers, Kafka Connect).
• Leverage Azure Cloud Services (ADF, ADLS, Azure Synapse/Databricks) for large-scale data processing.
• Write complex SQL queries and optimize database schemas for high-volume data warehouses.
• Monitor, troubleshoot, and tune ETL workflows and streaming jobs for optimal performance.

Mandatory Technical Qualifications

• Experience: 5+ years of hands-on experience in ETL development.
• Streaming: Strong hands-on expertise in Apache Kafka (real-time data streaming).
• Cloud Platform: Hands-on experience with the Azure Data ecosystem (ADF, ADLS, Synapse/Databricks).
• SQL: Advanced SQL querying skills and data transformation logic.

Key Skills

Education

Any Graduate