Description

You will design and implement secure, scalable cloud-based data pipelines, warehouses, and lakes on Azure. You own the data strategy, ensuring alignment with business goals and driving the selection of cloud data services.

Responsibilities

• Design and implement cloud data architecture, including pipelines and storage solutions.
• Produce clear visual diagrams (data flow, ER, system architecture) and maintain detailed documentation.
• Hands-on implementation of cloud data solutions using distributed computing frameworks.
• Identify performance bottlenecks and optimize data systems for speed and cost.
• Troubleshoot data quality issues and resolve pipeline failures.

Required Skills

• 5+ years of hands-on data engineering experience with distributed computing (Spark, MapReduce, Databricks).
• Proven track record of designing and implementing cloud-based data solutions in Azure.
• Deep understanding of data modeling concepts and techniques for both relational and non-relational databases.
• Strong proficiency with diagramming tools such as Visio, Lucidchart, or similar visualization software.
• Bachelor's degree in Computer Science or equivalent technical background.
• Experience with scripting languages, specifically Python and SQL.

Preferred Skills

• Advanced knowledge of Azure Data Lake and cloud-specific data services.
• Expertise in big data technologies like Hadoop and Spark.

Key Skills

Education

Bachelor's degree