Description

You will architect and build scalable data platforms.

Responsibilities

• Architect and implement scalable data warehouses on Azure Databricks using data and dimensional modeling.
• Design, develop, and optimize ETL/ELT pipelines using Python, PySpark, and Databricks.
• Establish ingestion, transformation, and storage best practices following the Bronze, Silver, Gold architecture.
• Build and deploy distributed data applications on Azure Databricks for performance and reliability.
• Manage Azure Data Lake Storage (ADLS) and Delta Lake with Unity Catalog for data governance.

Required Skills

• 8+ years of experience as a Data Engineer with strong expertise in Azure Databricks and PySpark.
• Proven experience in ETL/ELT pipeline development and large-scale data processing.
• Strong understanding of Medallion architecture (Bronze, Silver, Gold).
• Hands-on experience with ADLS, Delta Lake, and Unity Catalog.
• Strong knowledge of Python, Spark optimization, and distributed computing.
• Experience in cluster optimization and performance tuning.
• Proficiency in GitHub, CI/CD pipelines, and Azure DevOps.
• Excellent problem-solving skills to troubleshoot and optimize code.
• Strong communication and documentation skills.

Key Skills

Education

Any Graduate