Description

Lead engineering teams and oversee the design, development, and execution of technical deliverables for data platforms.

This role is on-site.

Responsibilities

• Lead and mentor engineers through technical guidance and collaborative workflows.
• Consult with client stakeholders on project status, technical issues, and proposals.
• Manage communication and coordination between onshore and offshore teams in India.
• Execute POC development, capacity sizing, and tool evaluations.
• Provide post-implementation support and manage Databricks job operations.

Required Skills

• 12+ years of experience in data engineering and architecture roles.
• Expertise running ETL jobs in Databricks using nested job structures and runtime parameters.
• Hands-on experience with Unity Catalog, Delta format, and S3-based Parquet files.
• Deep understanding of the pros and cons of Delta format.
• Experience running Databricks with AWS Glue Catalog.
• Proficiency in monitoring and operating Databricks jobs and scheduling tasks.
• Practical experience with MongoDB and AWS data engineering projects.

Preferred Skills

• Experience managing the full lifecycle of data engineering deliverables on time.

Key Skills

Education

Any Graduate