Description

You will design, build, and maintain scalable data engineering solutions on the Azure platform.

This role is remote.

Responsibilities

• Create and maintain optimal data pipeline architecture to move workloads from development to production.
• Assemble large, complex datasets that meet functional and non-functional business requirements.
• Drive optimization, testing, and tooling to improve the quality of data solutions.
• Manage end-to-end delivery by investigating problem areas and working cross-functionally with product managers and stakeholders.
• Ensure operational effectiveness regarding performance, uptime, and release management of the enterprise data platform.

Required Skills

• 7+ years of relevant experience in data engineering.
• Strong hands-on experience with Databricks and Unity Catalog.
• Expertise in the Azure Cloud platform.
• Proficiency with Python and PySpark.
• Experience with Apache Spark and orchestrating workloads on the cloud.
• Strong SQL knowledge and database engineering design principles.
• Experience handling large, complex datasets from various sources and databases.
• Bachelor's degree or equivalent experience in computer science.

Preferred Skills

• Experience with Teradata.
• Proficiency with APIs, containerization, and orchestration.
• Familiarity with CI/CD methods.

Key Skills

Education

Any Graduate