Description

You will engineer and maintain data solutions within the Azure ecosystem.

Responsibilities

• Design, build, and maintain scalable, automated data pipelines for batch and streaming ingestion and processing using Data Bricks workflows.
• Implement data models and architectures that meet business needs for efficient data analysis and reporting.
• Orchestrate data pipeline execution and manage dependencies using workflow tools.
• Integrate monitoring and alerting to track pipeline health and address performance bottlenecks.
• Apply Agile principles by participating in planning, stand-ups, reviews, and retrospectives.

Required Skills

• 5+ years of professional experience in data engineering.
• Proficiency in Python, PySpark, and PyTest.
• Strong knowledge of OOP concepts.
• Experience utilizing Azure cloud data platforms, specifically Data Bricks and Delta Live Tables.
• Familiarity with Unity Catalog.
• Experience with CI/CD practices.
• Working knowledge of Agile development methodologies.

Key Skills

Education

Bachelor's degree