Description

Design, architect, and deploy scalable big data solutions on MS Azure, managing the full lifecycle from requirement gathering to platform selection and deployment.

This role is on-site.

Responsibilities

• Design and maintain Big Data solutions using Azure cloud technologies.
• Manage the end-to-end lifecycle of Data Lake and Big Data platforms.
• Implement scalable cloud-based data architectures and infrastructure solutions.
• Collaborate with domain experts, data scientists, and developers to support secure, governed data consumption.
• Mentor Data Engineers and drive technical innovation.

Required Skills

• 9+ years of technical experience, including 5+ years on MS Azure.
• 2+ years of experience with Hadoop (CDH/HDP).
• Hands-on expertise with Azure Data Factory (ADF), ADLS, Databricks, Azure Synapse Analytics, Event Hub, Streaming Analytics, Cosmos DB, and Purview.
• Strong experience with big data technologies: Spark, Airflow, NiFi, Kafka, Hive, HBase, MongoDB, Neo4J, Elastic Search, Impala, Sqoop.
• Strong programming and debugging skills in Python, Java, or Scala.
• Experience with CI/CD using Git, Jenkins, or Azure DevOps.
• Hands-on experience with NoSQL databases and data modelling in Hive.

Preferred Skills

• Experience supporting BI and Data Science teams with secure, governed data consumption.

Key Skills

Education

Any gradudate