Description

You will design, implement, and maintain scalable data infrastructure and large-scale ingestion and transformation projects on Azure.

Responsibilities

• Build, integrate, and quality-assure data software and pipelines.
• Develop and maintain CI/CD pipelines and infrastructure as code.
• Mentor team members through design reviews, technical discussions, and prototyping.
• Collaborate with cross-disciplinary teams in a Scrum/Agile environment to deploy and audit cloud product processes.
• Ensure service reliability by following SRE practices, including monitoring, alerting, and on-call rotations.

Required Skills

• 5+ years of experience designing and delivering end-to-end Azure data solutions.
• Hands-on expertise with Azure Synapse and Azure Data Factory (ADF).
• Proficiency in Spark for large-scale data processing.
• Strong background in writing and optimizing complex SQL queries.
• Experience deploying scalable data pipelines using cloud-native tools.
• Practical exposure to CI/CD, infrastructure as code, and containerization.
• Experience working within Agile/Scrum delivery methodologies.
• Knowledge of software engineering standards including unit testing and source control.

Preferred Skills

• Experience with PySpark or Python in data engineering workflows.

Key Skills

Education

Any Graduate