Description

You will design and implement scalable, secure data architectures using Databricks, Spark, and Delta Lake.

This role is on-site.

Responsibilities

• Design and implement data lakehouses to ensure performance and cost-efficiency.
• Architect solutions for both real-time and batch data processing.
• Define best practices for data ingestion, transformation, and storage using Databricks notebooks, jobs, and workflows.
• Lead migration efforts from legacy systems to modern cloud-based platforms.
• Collaborate with engineers and stakeholders to define data models, pipelines, and governance strategies.

Required Skills

• 12+ years of experience in data architecture.
• 5+ years of hands-on experience with Databricks.
• Strong proficiency in AWS, specifically AWS Databricks.
• Strong proficiency in Apache Spark, Delta Lake, and PySpark.
• Strong experience with Snowflake.
• Experience with data modelling, ETL/ELT pipelines, and data warehousing.
• Familiarity with CI/CD, DevOps, and Infrastructure as Code (Terraform, ARM templates).
• Knowledge of data governance, security, and compliance frameworks.

Preferred Skills

• Databricks Certified Data Engineer or Architect.
• Experience with MLflow, Unity Catalog, and Lakehouse architecture.
• Experience with Apache Airflow, dbt, Power BI, or Tableau.

Key Skills

Education

Any Gradute