← Back to jobs

CareerNet Technologies Pvt Ltd Logo
Senior Director - Azure Databricks

CareerNet Technologies Pvt Ltd

 

Bangalore, Karnataka, India

Posted On: 11 days ago
Experience: 16+ years
Availability: Remote
Openings: 1
Category: Azure Databricks
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

Key Skills: Azure Databricks, Data Engineering

Roles and Responsibilities:

  • Provide client advisory on key engineering & architectural decisions across the full life cycle of big data engineering projects like Data Lake / Lakehouse implementation, DWH Modernization, Data Fabric implementation etc.
  • Work with strategic clients to help define their data engineering roadmaps.
  • Identify new ways of leveraging technology to solve client engineering problems.
  • Track latest tech innovations and build relevant PoVs & PoCs to further our capabilities.
  • Identify opportunities for Tiger to build IP. Lead the development efforts.
  • Lead capability building initiatives as part of our Innovation Lab and L&D Academy.
  • Participate in organization building, hiring, partnerships, conferences etc.

Skills Required:

  • 16+ years of data engineering experience with 5+ years in the Big Data and Azure ecosystem.
  • Experience of leading & mentoring multiple high-performing data engineering teams.
  • Good experience of working on proposals, defining solutions, roadmaps & plan, doing estimation etc.
  • Strong experience of working with the following technologies:
    • Azure ecosystem: Azure Databricks, Data Factory, Microsoft Fabric, Event Hub, Streaming Analytics, Cosmos DB, Unity Catalog and Purview.
    • Must have: Strong Experience of working on Databricks ecosystem (PySpark, Notebooks, Unity Catalog, DLT, Workflows, SQL Warehouse etc.).
    • Hadoop Ecosystem: Hadoop, Spark, Kafka, Hive, NoSQL - HBase / MongoDB / Cassandra, Impala, Sqoop etc.
    • Programming experience either in Python or Scala/Java.
    • CI/CD with Git, Jenkins / Azure DevOps.
    • Exposure to NoSQL Database and Data Modelling.
    • Good exposure to some of the emerging technologies like Gen AI, LLM etc.
  • Experience with:
    • Data lake / Lakehouse / data fabric / data mesh design and implementation.
    • Designing/building large cloud-based Data Platform solutions (on Azure).
    • Experience of building solutions to support BI and Data Science teams in consuming the data in a secure and governed manner.

Education: B.Tech/B.E from reputed institute preferred

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs