Description

Design, build, and maintain data analytics solutions on the Azure platform. Own the release pipeline and data engineering strategies for large-scale systems.

Responsibilities

• Develop batch and real-time analytical solutions using transformational technologies.
• Create and maintain optimal data pipeline architecture and data engineering strategies.
• Design key and indexing schemes, partitioning, operational data stores, and data marts.
• Code, test, and document new or modified data systems to ensure scalability.
• Implement and test medium to complex mappings and transform large datasets to meet business needs.

Required Skills

• Over 8 years of hands-on data engineering experience, preferably on the Azure platform.
• Proven experience with Azure Data Lake, Data Factory, Databricks, and Logic Apps.
• Experience delivering at least one greenfield Data Lake, Delta Lake, or Data Warehousing project in Azure.
• Advanced SQL skills and experience with relational databases and T-SQL.
• Proficiency in Python or other scripting languages.
• Experience with Azure Synapse Analytics, Azure SQL, PowerShell, Azure Automation, and Blob storage.
• Familiarity with CI/CD within the Azure DevOps platform.
• Knowledge of Big Data batch and streaming tools.
• Experience managing code repositories in large-scale data engineering platforms.

Preferred Skills

• Experience participating in design discovery sessions and workshops with end users.

Key Skills

Education

Any graduate