Description

Lead Databricks architecture, development, and implementation.
Drive migration of data pipelines and workloads from Azure Synapse to Databricks.
Develop scalable data processing solutions using PySpark, Spark SQL, and Python.
Design and implement Lakehouse architecture using Delta Lake and Unity Catalog.
Build and manage workflows using Databricks Workflows and Databricks Asset Bundles.
Work with Azure Data Factory, ADLS Gen2, and Azure SQL.
Optimize data pipelines, SQL queries, and Spark jobs for performance and scalability.
Establish coding standards, reusable frameworks, and engineering best practices.
Implement CI/CD pipelines using GitLab and participate in code reviews.
Mentor team members and lead technical design discussions

Key Skills

Education

Bachelor's degree