Description

You will design, develop, and optimize scalable data pipelines and cloud-based data solutions on Azure. You will own end-to-end solution delivery, from ETL/ELT processing and data modeling to performance tuning and governance.

This role is remote.

Responsibilities

• Build and maintain scalable data pipelines using Azure Databricks, PySpark, and Delta Lake.
• Orchestrate data workflows with Azure Data Factory (ADF) and manage storage in ADLS Gen2.
• Implement data governance and security standards using Unity Catalog.
• Develop and deploy REST or GraphQL APIs, including API security, contracts, and error handling.
• Deploy API services using Kubernetes (AKS) and manage CI/CD practices via GitHub.

Required Skills

• 10+ years of experience in data engineering and cloud solutions.
• Strong proficiency in Azure Databricks, PySpark, and Delta Lake.
• Hands-on experience with Azure Data Factory (ADF) and ADLS Gen2.
• Expertise in building REST or GraphQL APIs and understanding API security.
• Experience with Kubernetes (AKS preferred) for API deployment.
• Proficiency in Python, SQL, and CI/CD practices using GitHub.
• Understanding of data governance, security, and performance tuning.

Preferred Skills

• Exposure to AI/LLM or agentic frameworks (Databricks AI/ML, Codex, Claude, etc.).
• Experience with large-scale, cloud-native data platforms in enterprise environments.

Key Skills

Education

Any Graduate