Description

Lead a team of engineers to design, develop, and execute data deliverables while managing technical delivery and stakeholder relationships in San Diego.

Lead and mentor a team of engineers, coordinating workflows between onshore and offshore teams in India. Consult with client stakeholders on project status, technical proposals, and post-implementation support. Drive POC development, capacity sizing, and tool evaluation processes. Design and implement nested ETL jobs, including job scheduling and runtime parameter passing. Monitor and manage Databricks job operations and performance.

Responsibilities

• Lead and mentor a team of engineers, coordinating workflows between onshore and offshore teams.
• Consult with client stakeholders on project status, technical proposals, and post-implementation support.
• Drive POC development, capacity sizing, and tool evaluation processes.
• Design and implement nested ETL jobs, including job scheduling and runtime parameter passing.
• Monitor and manage Databricks job operations and performance.

Required Skills

• 12+ years of experience in data engineering and architecture.
• Hands-on experience running ETL jobs in Databricks Unity Catalog using Delta, MongoDB, and S3-based Parquet files.
• Deep understanding of Delta format on S3, including the ability to articulate technical pros and cons.
• Experience running Databricks integrated with AWS Glue Catalog.
• Proven experience managing data engineering projects within AWS environments.
• Proficiency with S3, Delta, MongoDB, Databricks, and AWS.
• Strong technical communication skills for client-facing consulting.

Key Skills

Education

Any Graduate