Description

You will build and manage data pipelines within Azure environments.

Responsibilities

• Build data integration pipelines, handling Python transformations and various source types.
• Implement models, business logic, and templated analysis/reports for data structure.
• Manage ontology by defining object types, functions, object views, actions, and permissions.
• Develop applications including workshops, writeback functionality, and advanced actions.
• Ensure data foundation, protection, governance, and restricted access/views are maintained.

Required Skills

• 5+ years of professional experience in data engineering.
• Strong proficiency in Python.
• Expertise in SQL.
• Hands-on experience with PySpark.
• Proficiency with Azure Databricks.
• Experience with Azure Data Factory.
• Demonstrable ability to build data pipelines and manage code repositories.
• Knowledge of data security, governance, and restricted access patterns.

Key Skills

Education

Any Graduate