Description

You will design and implement scalable and secure data architectures using Databricks, Spark, and Delta Lake.

Responsibilities

• Design and implement data architectures using Databricks, Spark, and Delta Lake.
• Define data models, pipelines, and governance strategies in collaboration with stakeholders.
• Develop and maintain data lakehouses, optimizing for performance and cost.
• Define best practices for data ingestion, transformation, and storage using Databricks workflows.
• Lead migration efforts from legacy systems to modern cloud data platforms.

Required Skills

• 14+ years of experience in data architecture.
• 5+ years hands-on experience with Databricks.
• Strong experience with Snowflake.
• Proficiency in Apache Spark, Delta Lake, and PySpark.
• Experience with AWS, specifically AWS Databricks.
• Knowledge of ETL/ELT pipelines and data modeling.
• Familiarity with CI/CD and DevOps principles.
• Knowledge of data governance, security, and compliance frameworks.

Key Skills

Education

Any Gradute