Description

You will serve as a technical lead for medium to large complex project or feature enhancements.

Responsibilities

• Design and develop data pipelines using Databricks on AWS.
• Work with Product, Project, Business, and UX teams to prioritize initiatives and features.
• Participate in grooming and priority setting, owning project sizing and estimation.
• Troubleshoot issues and tune performance across integrated systems with other development teams.
• Guide and troubleshoot production issues alongside the Production Support team.

Required Skills

• 10+ years of experience in data engineering.
• Strong command of SQL and proficiency in PySpark.
• Deep knowledge of Databricks architecture, tools, and capabilities.
• Experience designing and optimizing ETL/ELT pipelines using Databricks.
• Experience with Delta Lake and building data lakes.
• Proficiency with AWS services including S3, DataSync, and Lambda.
• Familiarity with CI/CD pipelines using Gitlab.
• Experience using Jira.
• Knowledge of Spark.

Key Skills

Education

Any Gradute