Description

You will own the architecture design and implementation of advanced analytics solutions using Azure Databricks Fabric.

Responsibilities

• Lead the architecture design and implementation of advanced analytics solutions using Azure Databricks Fabric.
• Oversee end-to-end implementation of data solutions, ensuring alignment with business requirements and best practices.
• Lead the development of data pipelines and ETL processes using Azure Databricks, PySpark, and other relevant tools.
• Integrate Azure Databricks with other Azure services like Azure Data Lake, Azure Synapse, and Azure Data Factory.
• Provide technical leadership and mentorship to the data engineering team while maintaining documentation and compliance.

Required Skills

• Strong experience with Azure Databricks, including cluster management, notebook development, and Delta Lake.
• Proficiency in big data technologies like Hadoop Spark and data processing frameworks such as PySpark.
• Deep understanding of Azure services: Azure Data Lake, Azure Synapse, and Azure Data Factory.
• Experience with ETL/ELT processes, data warehousing, and building data lakes.
• Strong SQL skills and familiarity with NoSQL databases.
• Experience with CICD pipelines and version control systems like Git.
• Knowledge of cloud security best practices.
• 10+ years of experience developing data ingestion and transformation pipelines using Databricks, Synapse notebooks, and Azure Data Factory.
• Mandatory knowledge of Azure Cloud Architecture and Cloud Solution Architecture.

Key Skills

Education

Any Graduate