Description

Lead engineers to design, develop, and execute data deliverables while managing client stakeholder relationships and technical decision-making.

This role is on-site.

Responsibilities

• Lead and mentor engineers, including senior staff, to ensure successful project execution and on-time delivery.
• Consult with clients on technical issues, project status, and proposals, providing post-implementation support.
• Coordinate workflows between onshore and offshore teams in India.
• Drive technical decision-making through POC development, capacity sizing, and tool evaluation.
• Manage the end-to-end lifecycle of Databricks jobs, including scheduling, monitoring, and operations.

Required Skills

• 5+ years of experience in data engineering projects within AWS environments.
• Expertise running ETL jobs in Databricks Unity Catalog using Delta, MongoDB, and S3-based Parquet files.
• Deep understanding of Delta format, including the ability to articulate its pros and cons.
• Experience running Databricks with AWS Glue Catalog.
• Proficiency in setting up nested ETL jobs and passing runtime parameters to jobs.
• Hands-on experience with Databricks job scheduling, monitoring, and operations.
• Strong technical communication skills for client-facing interactions and team coordination.

Preferred Skills

• Direct experience in a client-facing role.

Key Skills

Education

Any Graduate