Description

Develop and migrate data pipelines to a cloud-based management platform within the Enterprise Data Asset team.

Responsibilities

• Design and develop ETL processes for extracting business and spatial data into data warehousing environments.
• Build systems for the Data Asset Program (Data Hub), including spatial data pipelines and business intelligence components.
• Profile source data to identify conflicts, perform entity resolution, and manage metadata.
• Decompose requirements into Epics, Features, and user stories within an Agile framework.
• Design and support DW database schemas, table structures, and Data Marts optimized for reporting.

Required Skills

• 5+ years of experience in data engineering or ETL development.
• Proficiency in Python and SQL.
• Experience with Azure SQL Database, Data Factory V2, Data Lake Store, and Oracle.
• Technical knowledge of T-SQL and SQL Server.
• Experience using IBM DataStage and Erwin.
• Familiarity with Linux Shell scripting.
• Understanding of warehousing architecture including MOLAP, ROLAP, ODS, DM, and EDW.
• Ability to work within Agile/Sprint environments.

Preferred Skills

• Collaboration with data scientists and architects to refine requirements and migrate existing pipelines to new cloud architectures.

Key Skills

Education

Any Graduate