Description

You will design, build, and maintain scalable data architectures and end-to-end data solutions on Azure and AWS.

This role is on-site.

Responsibilities

• Architect and implement data ingestion pipelines, ETL/ELT processes, and high-velocity streaming solutions.
• Migrate data from traditional relational and on-premise systems to Azure technologies, specifically using OneLake and Fabric.
• Develop CI/CD strategies for Enterprise Data Platforms using Terraform and GitHub.
• Conduct POCs for new technologies and perform hands-on development, unit testing, and code reviews.
• Collaborate with ML Engineers and Data Scientists to operationalize data-driven decision making.

Required Skills

• 8 to 12 years of experience in data engineering or data lake implementation.
• Proficiency in Python, Spark, and SQL.
• Extensive experience with Microsoft Azure services including Data Factory, ADLS Gen2, Synapse Analytics, and Synapse Database.
• Hands-on experience with Microsoft Fabric and Power BI.
• Experience working with Object stores and structured, semi-structured, or unstructured data.
• Proven ability to develop business applications using NoSQL or SQL databases.
• Experience developing data-based APIs.
• Knowledge of Azure Service Fabric and KQL.
• Bachelor's degree in Computer Science, Software Engineering, MIS, or equivalent experience.

Preferred Skills

• Cloud certifications in Azure or AWS.
• Experience implementing solutions on AWS-based data lakes.

Key Skills

Education

Bachelor's degree