Description

You will design, implement, and optimize scalable data engineering solutions on the Azure platform.

This role is remote.

Responsibilities

• Create and maintain data pipeline architecture for large, complex datasets.
• Manage end-to-end delivery by investigating issues and collaborating with product managers and stakeholders.
• Drive optimization, testing, and tooling to improve data solution quality and velocity.
• Oversee operational effectiveness, including performance, uptime, and release management for the enterprise data platform.
• Train counterparts in data pipelining and preparation techniques.

Required Skills

• 7-12 years of relevant experience in data engineering.
• Strong hands-on experience with Databricks and Unity Catalog.
• Proficiency in Python and PySpark programming.
• Deep expertise in the Azure Cloud platform and Apache Spark.
• Solid knowledge of SQL and database engineering and design principles.
• Experience orchestrating workloads on the cloud.
• Ability to handle large, complex datasets from multiple databases and sources.
• Experience working within Agile development methodologies.
• Bachelor's or Master's degree in Computer Science or equivalent experience.

Preferred Skills

• Experience building and leading highly complex technical engineering teams.
• Proficiency with APIs, containerization, and orchestration.
• Familiarity with CI/CD methods and Teradata.

Key Skills

Education

Any Graduate