Description

You will architect, design, and implement advanced analytics solutions using Azure Databricks/Fabric.

Responsibilities

• Lead the design and implementation of advanced analytics solutions using Azure Databricks/Fabric.
• Oversee end-to-end data solution implementation, ensuring alignment with business requirements.
• Develop data pipelines and ETL processes using Azure Databricks, PySpark, and relevant tools.
• Integrate Azure Databricks with Azure Data Lake, Azure Synapse, Azure Data Factory, and on-premise systems.
• Provide technical leadership and mentor the data engineering team on best practices for code quality and scalability.

Required Skills

• 8+ years developing data ingestion and transformation pipelines using Databricks/Synapse notebooks and Azure Data Factory.
• Strong experience with Azure Databricks, including cluster management, notebook development, and Delta Lake.
• Proficiency in big data technologies (Hadoop, Spark) and data processing frameworks (PySpark).
• Deep understanding of Azure services: Azure Data Lake, Azure Synapse, and Azure Data Factory.
• Strong SQL skills and experience with ETL/ELT processes and data warehousing.
• Experience building and optimizing query layers using Databricks SQL.
• Familiarity with CI/CD pipelines and Git for version control.
• Solid understanding and hands-on experience with Delta tables and Azure Data Lake Storage Gen2.
• Knowledge of cloud security best practices.

Key Skills

Education

Any Graduate