Description

Design and build data solutions leveraging Microsoft Azure services.

This role is hybrid.

Responsibilities

• Develop and maintain Azure solutions, ensuring data is cleansed, mapped, and transformed per technical and business needs.
• Build data pipelines to ingest, extract, and consolidate data into data warehouses and real-time systems.
• Automate tasks and deploy production-ready code, incorporating unit testing and version control.
• Design data architectures and optimize large datasets for efficient storage and querying.
• Troubleshoot and maintain existing data warehouse and data pipelines.

Required Skills

• 10+ years of experience in a data engineering or architect role.
• Expertise in building and optimizing 'big data' pipelines and architectures.
• Proficiency with Python, SQL, and Scala.
• Experience with distributed processing using Spark and Spark-SQL.
• Hands-on experience with Azure services: ADLS, Databricks, Azure Functions, and ARM Templates.
• Strong ability to design and implement well-written, testable code.
• Familiarity with NoSQL databases and data warehousing concepts.
• Capability to test data integrity from source to presentation layer.

Key Skills

Education

Any Graduate