Description

You will design and build data pipelines and manage data infrastructure.

Responsibilities

• Identify, clarify, analyze, and confirm data sourcing or data change requests for ETL pipelines.
• Ensure development backlog is prioritized and accurately reflects team work.
• Assist developers through intake, development, testing, and release of new features.
• Liaise between stakeholders, Product Owners, and upstream source systems.
• Maintain up-to-date documentation and runbooks.

Required Skills

• 8+ years of relevant experience in a data engineering function.
• Strong command of Python and PySpark for large-scale data processing.
• Experience administering Data Bricks and building ELT pipelines.
• Proficiency with Azure Cloud services, including Data Factory.
• Experience automating deployments using Jenkins, Azure DevOps, and GitHub Actions.
• Familiarity with Jira and Confluence for backlog and documentation.
• SQL performance tuning for data analytics workloads.

Preferred Skills

• Azure certified.
• Data Bricks certified.

Key Skills

Education

Any Gradute