Description

Design and implement secure, scalable data solutions within the Databricks Lakehouse ecosystem, focusing on PHI/PII protection and data governance.

This role is on-site.

Responsibilities

• Architect and build secure, interoperable data platforms using Databricks, Delta Lake, and Apache Iceberg.
• Implement rigorous data security controls, including RBAC, data masking, encryption, and data minimization strategies.
• Develop scalable data applications, APIs, and self-service analytics platforms integrated with AI/ML capabilities.
• Optimize platform performance through caching, query tuning, and efficient data architecture practices.
• Build monitoring frameworks and dashboards to ensure data integrity and system observability.

Required Skills

• 10+ years of experience in data engineering, data architecture, or data security roles.
• Deep hands-on expertise with the Databricks Lakehouse platform and Microsoft Azure cloud services.
• Proven experience handling PHI/PII data, including classification and compliance with relevant frameworks.
• Proficiency in Python, SQL, and Spark (PySpark/Scala) for building scalable data applications.
• Strong knowledge of data security techniques, specifically data masking, encryption, and access control.
• Experience integrating Databricks with Snowflake or similar modern data platforms.
• Expertise in modern table formats: Delta Lake and Apache Iceberg.
• Ability to design and implement RBAC and robust access control frameworks.

Preferred Skills

• Experience with AI/ML integrations and enabling self-service analytics ecosystems.

Key Skills

Education

Any Gradute