Description

You will lead the design, implementation, and optimization of enterprise data architecture using Databricks.

Responsibilities

• Design and implement scalable and secure data architectures using Databricks, Spark, Delta Lake, and cloud-native tools.
• Collaborate with data engineers and stakeholders to define data models, pipelines, and governance strategies.
• Develop and maintain data lakehouses, focusing on performance and cost-efficiency.
• Define best practices for data ingestion, transformation, and storage using Databricks workflows.
• Lead migration efforts from legacy systems to modern cloud-based data platforms.

Required Skills

• 12+ years of experience in data architecture, including 5+ years hands-on with Databricks.
• Strong proficiency in Apache Spark, Delta Lake, and PySpark.
• Experience with data modelling, ETL/ELT pipelines, and data warehousing.
• Experience in cloud platforms, specifically AWS and AWS Databricks.
• Familiarity with CI/CD, DevOps, and Infrastructure as Code (Terraform).
• Knowledge of data governance, security, and compliance frameworks.
• Experience with BI tools such as Power BI or Tableau.

Key Skills

Education

Any Gradute