Description

Design and implement scalable data engineering solutions on AWS and Databricks. You will lead architecture discussions, optimize pipelines, and mentor engineering teams to ensure platform reliability and performance.

This role is on-site.

Responsibilities

• Design and implement scalable data engineering solutions on AWS and Databricks platforms.
• Develop and optimize ETL/ELT pipelines using PySpark and Delta Live Tables.
• Lead architecture discussions and recommend best-fit data solutions for business requirements.
• Collaborate with stakeholders to translate business needs into technical solutions and drive client communication.
• Mentor engineering teams and ensure best practices in data engineering and cloud architecture.

Required Skills

• 10+ years of experience with strong hands-on expertise in modern data lakehouse architecture.
• Deep proficiency in AWS and Databricks platforms.
• Strong experience with PySpark for data processing and ETL/ELT development.
• Expertise in Delta Live Tables for pipeline management.
• Solid background in data modeling and pipeline optimization.
• Experience with cloud architecture design and implementation.

Preferred Skills

• CI/CD and DevOps practices.
• AWS or Databricks certifications.
• Agile delivery experience and team leadership skills.

Key Skills

Education

Any Graduate