Description

You will architect and implement advanced analytics solutions using Azure Databricks Fabric.

Responsibilities

• Lead the design and implementation of advanced analytics solutions using Azure Databricks Fabric.
• Develop data pipelines and ETL processes using Azure Databricks, PySpark, and relevant tools.
• Integrate Azure Databricks with services like Azure Data Lake, Azure Synapse, and Azure Data Factory.
• Oversee end-to-end data solution implementation, ensuring alignment with business requirements.
• Provide technical leadership and mentor the data engineering team.

Required Skills

• 12+ years of expertise developing data ingestion and transformation pipelines using Databricks, Synapse notebooks, and Azure Data Factory.
• Strong experience with Azure Databricks, including cluster management and notebook development.
• Proficiency in big data technologies like Hadoop and PySpark.
• Deep understanding of Azure services such as Azure Data Lake, Azure Synapse, and Azure Data Factory.
• Strong SQL skills and familiarity with NoSQL databases.
• Experience with ETL/ELT processes, data warehousing, and building data lakes.
• Familiarity with CICD pipelines and version control systems like Git.
• Bachelor's degree.

Key Skills

Education

Bachelor's degree