Description

You will lead the design, implementation, and optimization of enterprise data architecture using Databricks.

Responsibilities

• Design and implement scalable and secure data architectures using Databricks, Spark, and Delta Lake.
• Collaborate with engineers, analysts, and stakeholders to define data models, pipelines, and governance strategies.
• Develop and maintain data lakehouses, ensuring optimal performance and cost-efficiency.
• Define best practices for data ingestion, transformation, and storage using Databricks workflows.
• Lead migration efforts from legacy systems to modern cloud-based data platforms.

Required Skills

• 12+ years of experience in data architecture, including 5+ years hands-on with Databricks.
• Strong experience with Snowflake.
• Proficiency in cloud platforms, specifically AWS and AWS Databricks.
• Strong proficiency in Apache Spark, Delta Lake, and PySpark.
• Experience with data modelling, ETL/ELT pipelines, and data warehousing.
• Familiarity with CI/CD, DevOps, and Infrastructure as Code (Terraform, ARM templates).
• Knowledge of data governance, security, and compliance frameworks.
• Experience with Power BI or Tableau.
• Excellent communication and stakeholder management skills.

Key Skills

Education

Any Gradute