Description

You will design and implement secure, scalable cloud-based data pipelines, warehouses, and data lakes within Azure environments.

Responsibilities

• Design and implement cloud data architectures, including storage, databases, and analytics tools.
• Produce visual diagrams such as data flow, entity-relationship, and system architecture diagrams.
• Maintain detailed documentation covering architecture, design decisions, and processes.
• Contribute to hands-on implementation and performance optimization of cloud data systems.
• Troubleshoot issues related to data pipelines, quality, and accessibility.

Required Skills

• 5+ years of hands-on data engineering experience using distributed computing.
• Proven experience designing and implementing cloud-based data solutions in Azure.
• Proficiency with Spark, MapReduce, and Databricks.
• Strong knowledge of Data Warehouses, Hadoop, and Azure Data Lake.
• Deep understanding of data modeling and both relational and non-relational database systems.
• Proficiency in Python and SQL.
• Advanced diagramming skills using Visio, Lucidchart, or similar software.
• Bachelor's degree in Computer Science Engineering.

Preferred Skills

• Expertise in big data technologies and cloud-specific data services.
• Understanding of data security and governance principles.

Key Skills

Education

Bachelor's degree