Description

You will lead the design and implementation of scalable data platforms using Azure and Databricks.

Responsibilities

• Architect, design, and implement scalable data platforms and pipelines on Azure and Databricks.
• Build and optimize data ingestion, transformation, and processing workflows for batch and real-time data streams.
• Lead the development of complex ETL/ELT pipelines, ensuring high quality and performance.
• Design and implement data models for analytics and operational workloads, utilizing relational and lakehouse systems.
• Mentor junior engineers and enforce engineering standards for the data platform.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency in Azure and Databricks environments.
• Expertise with ADLS, Delta Lake, and Spark using Python.
• Experience building complex ETL/ELT pipelines.
• Working knowledge of PostgreSQL.
• Ability to define and enforce data governance and quality standards.
• Experience translating business requirements into technical data solutions.

Key Skills

Education

Any Graduate