Description

You will architect, design, and implement advanced analytics solutions using Azure Databricks/Fabric.

Responsibilities

• Lead the architecture and end-to-end implementation of data solutions, ensuring alignment with business needs.
• Develop data pipelines and ETL processes utilizing Azure Databricks, PySpark, and related tools.
• Integrate Azure Databricks with services like Azure Data Lake, Azure Synapse, and Azure Data Factory, plus on-premise systems.
• Provide technical leadership and mentor the data engineering team on best practices.
• Document architecture, processes, and data flows while adhering to security and governance standards.

Required Skills

• 8+ years of experience developing data ingestion and transformation pipelines with Databricks/Synapse notebooks.
• Strong experience with Azure Databricks, including cluster management and notebook development.
• Proficiency in big data technologies (Hadoop, Spark) and processing frameworks like PySpark.
• Deep understanding of Azure services: Azure Data Lake, Azure Synapse, and Azure Data Factory.
• Strong SQL skills and experience with ETL/ELT processes and data warehousing.
• Hands-on experience with Delta tables, Delta Lake, and Azure Data Lake Storage Gen2.
• Familiarity with CI/CD pipelines and version control systems like Git.

Key Skills

Education

Any Gradute