Description

Design and implement enterprise-grade data platforms on Databricks, owning the end-to-end architecture from ingestion to consumption.

This role is on-site.

Responsibilities

• Architect and build scalable data solutions using Delta Lake and Apache Spark.
• Develop and orchestrate ETL/ELT pipelines using Azure Data Factory (ADF) or equivalent cloud tools.
• Optimize cluster configurations and query performance to reduce costs and improve speed.
• Implement data security, governance, and access control policies within cloud environments.
• Collaborate with stakeholders to translate technical requirements into actionable data strategies.

Required Skills

• 5+ years of experience designing and implementing data platforms.
• Deep expertise in Apache Spark, Delta Lake, and distributed data processing.
• Proficiency in Python, Scala, or SQL for data engineering and analytics.
• Hands-on experience with Azure (ADF, ADLS), AWS (S3, Glue), or GCP (GCS, BigQuery).
• Strong understanding of data integration, ETL/ELT frameworks, and orchestration tools.
• Experience with performance tuning, cluster configuration, and cost optimization.
• Familiarity with DevOps and CI/CD practices for data platforms.

Key Skills

Education

Any Gradute