Description

You will design, architect, and deploy scalable data solutions on MS Azure, managing the full lifecycle from requirement gathering to platform selection, design, and deployment. You will implement solutions that scale on the cloud, collaborate with business experts and data scientists, and mentor a team of Data Engineers while exploring new technologies for creative problem solving.

Responsibilities

• Design and maintain Big Data solutions using Azure cloud technologies.
• Manage the end-to-end lifecycle of Data Lake and Big Data platforms.
• Implement scalable cloud-based data architectures.
• Collaborate with domain experts, data scientists, and developers.
• Mentor Data Engineers and drive technical innovation.

Required Skills

• 9+ years of technical experience, including 5+ years on MS Azure.
• 2+ years of experience with Hadoop (CDH/HDP).
• Hands-on expertise with Azure Data Factory (ADF), ADLS, Databricks, Azure Synapse Analytics, Event Hub, Streaming Analytics, Cosmos DB, and Purview.
• Strong experience with big data technologies: Spark, Airflow, NiFi, Kafka, Hive, HBase, MongoDB, Neo4J, Elastic Search, Impala, Sqoop.
• Strong programming and debugging skills in Python, Java, or Scala.
• Experience with CI/CD using Git, Jenkins, or Azure DevOps.
• Experience supporting BI and Data Science teams with secure, governed data consumption.
• Experience setting up cloud-computing infrastructure solutions.
• Hands-on experience with NoSQL databases and data modelling in Hive.

Key Skills

Education

Any gradudate