Description

You will design and maintain large-scale data architectures and pipelines within the Azure ecosystem.

Responsibilities

• Build and manage data pipelines to integrate data from disparate sources into the enterprise data lake.
• Cleanse, map, and transform data to optimize it for storage and downstream analytics.
• Load processed data into data warehouses, high-speed indexes, and real-time reporting systems.
• Automate tasks and deploy production-standard code using unit testing, continuous integration, and versioning.
• Troubleshoot and maintain the data warehouse and existing Azure solutions.

Required Skills

• 12+ years of technical experience in data engineering.
• 10+ years of hands-on experience with Azure Data Factory and Databricks.
• Expertise in Big Data ecosystem tools including Hadoop and Hive.
• Proficiency in Python or C# is mandatory.
• Extensive experience with Azure SQL DW and Analysis Services.
• Working knowledge of Azure Functions and serverless architecture.
• Experience deploying infrastructure using ARM Templates.
• Strong SQL skills for data manipulation and warehouse maintenance.

Preferred Skills

• Bachelor's degree in a relevant field.

Key Skills

Education

Bachelor's degree