Description

You will build, test, and support scalable data pipelines.

Responsibilities

• Build and evolve data integrations, including APIs, to handle increasing data volume and complexity.
• Establish and enforce data governance processes to ensure data integrity and security.
• Design and develop data integrations alongside a data quality framework.
• Design, implement, and automate deployment of distributed systems for streaming event processing.
• Collaborate with business teams to improve data models feeding BI tools.

Required Skills

• 5+ years of relevant experience in data engineering or business intelligence.
• Strong proficiency in Python, PySpark, and SQL.
• Demonstrable experience with Databricks.
• Experience developing integrations across multiple systems and APIs.
• Familiarity with Agile software development methodologies.
• Experience with Azure technologies, specifically Azure Data Lake, ADF, and Azure DevOps.
• Experience creating ETL and/or ELT jobs.
• Excellent problem-solving and troubleshooting skills related to data issues.

Key Skills

Education

Any Graduate