Description

You will design, build, and maintain end-to-end data pipelines within the Azure ecosystem. You own the lifecycle from Proof of Concept delivery to post-production support.

Responsibilities

• Design and build end-to-end data pipelines to meet specific customer requirements.
• Perform unit testing, support user acceptance testing, and manage post-production deployment activities.
• Maintain and resolve existing production code, scripts, and pipelines during incidents.
• Review team designs and code to ensure quality and adherence to best practices.
• Own Proof of Concept projects from inception through to delivery.

Required Skills

• 2+ years of full-time data engineering experience.
• 2+ years of hands-on experience with Azure services, including Azure Data Factory, Storage accounts, and Notebooks.
• Proficiency in SQL and PL/SQL.
• Practical experience implementing ETL/ELT processes and working with ETL tools.
• Experience with Hadoop and Big Data ecosystems.
• Hands-on experience migrating data from on-premise environments to the cloud.
• Ability to debug issues and utilize log analytics for troubleshooting.
• Bachelor's degree in Computer Science, IT, or equivalent professional experience.
• Fluent written and spoken English.

Key Skills

Education

Bachelor's degree in Computer Science