Description

Design, operate, and manage data lake infrastructure to support efficient storage, processing, and analysis.

Responsibilities

• Operate and maintain data lake infrastructure to ensure reliability, scalability, and security.
• Design and develop ETL processes and ingestion pipelines to integrate data from APIs, on-prem, cloud, and legacy systems.
• Build initial wireframes, proof of concepts, and architecture designs for data lake and ETL processes.
• Optimize data processing workflows and monitor performance metrics for retrieval and analysis efficiency.
• Ensure data policy adherence, including row-level security and data privacy within produced models and pipelines.

Required Skills

• 5+ years of experience in data architecture or related roles.
• Hands-on experience with Azure and AWS data warehousing.
• Proficiency with Databricks for analytical processing.
• Expertise in designing and managing Data Lake environments.
• Strong understanding of ETL processes and data ingestion pipelines.
• Ability to design secure, monitored, and reliable "source of truth" data systems.
• Experience creating user stories and divisional personas to solve business challenges.
• Strong oral and written communication skills for stakeholder engagement.

Key Skills

Education

Any Graduate