Description

You will lead the architectural design for data migration projects using Azure services and SQL.

Responsibilities

  • Lead architectural design for migration projects to create scalable and efficient data solutions.
  • Design and implement advanced data transformation tasks using Databricks, PySpark, and Azure Data Factory.
  • Deploy and manage Databricks clusters, optimizing for performance and cost efficiency.
  • Mentor developers on PySpark best practices and reusable code patterns.
  • Document architectural designs, migration plans, and technical specifications for stakeholders.

Required Skills

  • Data Architecture design experience.
  • Databricks implementation and management.
  • Azure Data Factory (ADF) development.
  • PySpark for data transformation and analysis.
  • SQL proficiency.
  • Experience designing data pipelines and storage solutions.
  • Proven ability to translate business requirements into technical specifications.
  • Minimum 3 years of relevant experience.