Description

You will design and optimize large-scale data pipelines using Databricks, Python, and Apache Spark.

This role is hybrid.

Responsibilities

• Build and maintain efficient data pipelines using PySpark and SQL within the Databricks platform.
• Implement Medallion Architecture (Bronze, Silver, Gold) and Delta Lake best practices.
• Manage Unity Catalog and leverage Time Travel for data governance and reliability.
• Lead client projects, manage technical pods, and handle effort estimation and planning.

Required Skills

• 6+ years of professional experience in data engineering.
• Strong expertise in Python, SQL, and Apache Spark (PySpark).
• Hands-on experience with Databricks, including Delta tables and lakehouse architecture.
• Solid understanding of data modelling, data warehousing concepts, and SCD (Slowly Changing Dimensions).
• Proven ability to performance tune queries and process large-scale datasets.
• Experience leading client-facing projects and managing teams.

Preferred Skills

• Strong stakeholder management and communication skills.

Refer and earn Rs.50,000/-

Key Skills

Education

Any Graduate