Description
You will design and own enterprise-scale Azure Databricks Lakehouse solutions, establishing the core data architecture, governance standards, and platform engineering practices for the organization.
This role is remote.
Responsibilities
- Architect and implement enterprise-scale Azure Databricks Lakehouse solutions using Medallion Architecture (Bronze, Silver, Gold) and Delta Lake.
- Design scalable data ingestion frameworks leveraging Fivetran, REST APIs, SFTP, CDC, and incremental loading strategies.
- Define and govern enterprise data governance frameworks, including Unity Catalog configuration for RBAC, row-level security, auditing, and lineage.
- Establish Power BI semantic modeling standards, including datasets, DAX measures, calculation groups, and composite models.
- Implement CI/CD pipelines for Databricks notebooks and jobs, ensuring automated data quality validations and observability metrics.
Required Skills
- 12+ years of experience in data architecture, warehousing, and engineering.
- Deep expertise with Azure Databricks, Delta Lake, and Unity Catalog.
- Strong background in Data Governance, IAM, RBAC, and data lifecycle management.
- Experience implementing CI/CD pipelines for data platforms.
- Proficiency in data modeling techniques for enterprise analytics.
- Knowledge of retail industry data patterns is preferred.
Preferred Skills
- Experience with Power BI semantic modeling, DAX, and calculation groups.
- Familiarity with Fivetran and automated data ingestion tools.
- Ability to mentor data engineers and technical teams on architecture best practices.
Referral Bonus: ₹50,000 INR