You will lead the architectural design for data migration projects using Azure services and SQL.
Responsibilities
- Lead architectural design for migration projects to create scalable and efficient data solutions.
- Design and implement advanced data transformation tasks using Databricks, PySpark, and Azure Data Factory.
- Deploy and manage Databricks clusters, optimizing for performance and cost efficiency.
- Mentor developers on PySpark best practices and reusable code patterns.
- Document architectural designs, migration plans, and technical specifications for stakeholders.
Required Skills
- Data Architecture design experience.
- Databricks implementation and management.
- Azure Data Factory (ADF) development.
- PySpark for data transformation and analysis.
- SQL proficiency.
- Experience designing data pipelines and storage solutions.
- Proven ability to translate business requirements into technical specifications.
- Minimum 3 years of relevant experience.