Description

You will design, implement, and manage end-to-end data solutions to turn large datasets into actionable business value.

Responsibilities

• Build and deliver the data supply chain by ingesting, cleansing, and transforming data from various sources into unified datasets.
• Implement data solutions on cloud platforms following Data Ops principles.
• Design and execute tests for implementations, correcting errors to ensure technical accuracy.
• Collaborate with architects to develop data architecture and processing strategies.
• Manage data security, archiving, structure, and storage requirements.

Required Skills

• 4+ years of experience in Data Engineering roles.
• 2+ years leading end-to-end design and implementation of large-scale data solutions.
• Proficiency in Python for data munging and processing.
• Experience with Azure data management components including Azure SQL, ADLS, and Cosmos.
• Experience building and automating data pipelines using MS Azure via IaaS, PaaS, or SaaS models.
• Hands-on experience with Spark (Databricks).
• Proficiency with Azure DevOps.
• Strong understanding of data modeling and data storage technologies.
• Degree in Mathematics, Scientific, Computing, Engineering, or equivalent experience.

Preferred Skills

• Experience with ETL or data integration tools such as Informatica, DataStage, or SSIS.
• Experience working within tightly regulated industries.

Key Skills

Education

Any Graduate