Description

You will design and lead the implementation of scalable data engineering solutions and technical vision.

This role is remote.

Responsibilities

• Design and implement scalable, sustainable data engineering solutions using Databricks, Azure, and Apache Spark.
• Create, maintain, and optimize data pipelines as workloads transition from development to production.
• Lead technical vision while balancing business drivers and stakeholder requirements.
• Handle large, complex datasets from various sources and databases.
• Work cross-functionally with product management and customers to understand product personas.

Required Skills

• 8+ years of relevant experience in data engineering or architecture.
• 5+ years of experience building and leading complex technical engineering teams.
• Strong hands-on experience with Databricks and PySpark.
• Proficiency in Python programming and Apache Spark.
• Expertise in Azure Cloud platform and Azure Data Factory.
• Strong SQL knowledge and database engineering/design principles.
• Experience orchestrating workloads on the cloud.

Preferred Skills

• Proficiency with APIs, containerization, and orchestration.
• Familiarity with CI/CD methods.
• Experience with Teradata.

Key Skills

Education

Any Graduate