Description

You will engineer and maintain scalable data solutions within the Azure ecosystem.

This role is remote.

Responsibilities

• Design and build automated data pipelines for batch and streaming ingestion using Databricks workflows.
• Implement data models and architectures to support efficient data analysis and reporting.
• Orchestrate pipeline execution and manage dependencies using workflow tools.
• Integrate monitoring and alerting to track pipeline health and resolve performance bottlenecks.
• Apply Agile principles by participating in planning, stand-ups, reviews, and retrospectives.

Required Skills

• 5+ years of professional experience in data engineering.
• Proficiency in Python and PySpark.
• Experience with PyTest for unit testing.
• Strong knowledge of Object-Oriented Programming (OOP) concepts.
• Experience utilizing Azure cloud data platforms, specifically Databricks and Delta Live Tables.
• Familiarity with Unity Catalog.
• Experience with CI/CD practices.
• Working knowledge of Agile development methodologies.

Key Skills

Education

Bachelor's degree