← Back to jobs

IBU Consulting Ltd Logo
Azure Databricks Engineer

IBU Consulting Ltd

 

Bengaluru, KA, India

Posted On: Just posted
Experience: 5+ years
Availability: Onsite
Openings: 1
Category: Azure Databricks
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

You will design, build, and optimize large-scale data engineering pipelines on Azure Databricks, ensuring performance, reliability, and production readiness.

This role is on-site.

Responsibilities

  • Develop and maintain ETL/ELT pipelines using PySpark and Databricks on Azure.
  • Design and implement scalable data warehousing solutions using Azure services such as ADLS and Key Vault.
  • Performance tune and optimize PySpark jobs and Databricks workflows for large-scale data processing.
  • Implement monitoring, logging, and data quality frameworks for validation, reconciliation, and error handling.
  • Convert proof-of-concept solutions into robust, production-ready architectures.

Required Skills

  • 5+ years of experience in data engineering.
  • Strong hands-on experience with Databricks on Azure.
  • Proficiency in PySpark and large-scale data processing.
  • Deep understanding of SQL and data warehousing concepts.
  • Experience with Azure services (ADLS, Key Vault, etc.).
  • Experience with orchestration tools like Databricks Jobs.
  • Bachelor's degree in Computer Science or related field.

Preferred Skills

  • Exposure to data quality frameworks and practices.
  • Willingness to work in the 2nd shift and at the client office.

Education

Bachelor's degree

Related Jobs

No related jobs found

← Back to jobs