Description

Lead architectural design and implementation for data migration projects using Azure and Databricks.

This role is remote.

Responsibilities

• Design and implement advanced data transformation tasks using Databricks, PySpark, and ADF.
• Deploy and manage Databricks clusters to optimize performance and cost efficiency.
• Mentor developers on PySpark best practices and reusable code patterns.
• Translate business requirements into technical specifications for data pipelines and storage.
• Document architectural designs, migration plans, and technical workflows.

Required Skills

• 5+ years of experience in data architecture or related roles.
• Proficiency with Databricks and PySpark for data transformation and analysis.
• Hands-on experience with Azure Data Factory (ADF) and broader Azure Services.
• Strong SQL skills for data manipulation and management.
• Proven track record in designing and implementing data pipelines and workflows.
• Experience managing and troubleshooting Databricks clusters.
• Degree in any graduate field.

Key Skills

Education

Any Gradute