Description
You will lead the assessment, design, and execution of Hive Metastore migrations to Unity Catalog.
Responsibilities
- Run UCX Assessment Tools to evaluate migration complexity, dependencies, and readiness.
- Configure Azure cloud resources, including storage accounts, IAM roles, and networking.
- Design catalog and schema hierarchies and develop ACL/permission migration strategies.
- Execute table and view migrations using UCX tools and upgraded notebooks.
- Validate data integrity, job executions, and BI report accuracy post-migration.
Required Skills
- 10+ years of experience in data platform engineering or migration projects.
- Deep proficiency with Databricks and Unity Catalog.
- Hands-on experience with Hive Metastore and UCX assessment tools.
- Expertise in Azure cloud platforms, specifically IAM and networking setup.
- Experience managing Data Platform migrations and security policy governance.
- Ability to update BI tool configurations and application connection strings.
- Strong documentation skills for migration runbooks and rollback procedures.