Description

You will design, build, and manage the data lake infrastructure to support scalable storage, processing, and self-service analytics.

Responsibilities

• Operate and maintain data lake infrastructure to ensure reliability, scalability, and security.
• Design and develop ETL pipelines to ingest data from APIs, on-prem, cloud, and legacy systems.
• Build wireframes, proofs of concept, and architectural designs for data storage and replication.
• Optimize data processing workflows and monitor performance metrics for continuous improvement.
• Implement data policy adherence, including row-level security and data privacy within pipelines.

Required Skills

• 3+ years of experience with Azure and AWS data warehousing.
• Hands-on experience with AWS Data Storage and Microsoft Azure.
• Proficiency using Databricks for analytical processing.
• Proven ability to design and implement ETL processes and data pipelines.
• Experience managing data ingestion from diverse sources including APIs and legacy systems.
• Ability to translate business challenges into technical data lake solutions.
• Strong ability to research and implement best practices for large-scale digital data deployments.

Key Skills

Education

Any Graduate