Description

You will lead the architectural design for data migration projects using Azure services, Databricks, and PySpark.

This role is hybrid.

Responsibilities

• Design and implement data transformation tasks using Databricks, PySpark, and Azure Data Factory.
• Deploy and manage Databricks clusters to ensure performance and cost efficiency.
• Translate business requirements into technical specifications for data pipelines and storage solutions.
• Mentor developers on PySpark best practices and reusable code patterns.
• Document architectural designs, migration plans, and technical best practices.

Required Skills

• 5+ years of experience in data-focused roles.
• Data Architecture design and implementation.
• Databricks cluster management and optimization.
• PySpark for data transformation and analysis.
• Azure Data Factory (ADF) design and deployment.
• SQL for data processing and management.
• Experience designing scalable data pipelines and transformation workflows.

Key Skills

Education

Any Graduate