Description

You will lead the technical direction for enterprise data engineering solutions.

This role is on-site.

Responsibilities

• Design and optimize scalable data pipelines for analytics, AI/ML, and BI workloads.
• Implement ETL/ELT solutions for multi-source data ingestion and transformation.
• Drive DevOps adoption using CI/CD automation and Infrastructure as Code.
• Manage and optimize Azure cloud data storage for cost and performance.
• Mentor junior engineers and foster continuous improvement in engineering practices.

Required Skills

• 7+ years building enterprise-level data solutions on cloud platforms.
• Expertise in Databricks for orchestrating production-grade pipelines.
• Strong proficiency in Python and SQL for ETL/ELT and ML workflows.
• Proven experience with Azure services (Data Factory, Data Lake, Synapse, Key Vault).
• Hands-on experience with Apache Spark (PySpark) for distributed data processing.
• Demonstrable skill in CI/CD automation and DevOps practices.
• Experience with data governance frameworks, focusing on quality and compliance.

Preferred Skills

• Familiarity with message queuing systems like Kafka.
• Experience with Airflow for workflow orchestration.

Key Skills

Education

Any Graduate