Description

You will design and build scalable batch and streaming data pipelines, data lake architectures, and warehousing solutions on the Databricks platform.

Responsibilities

• Design and develop scalable batch and streaming data pipelines.
• Build and maintain data lake architectures and data warehousing solutions.
• Implement Databricks Lakehouse concepts to optimize data processing.
• Ensure data integrity and performance across distributed systems.

Required Skills

• 8+ years of experience in data engineering roles.
• Expertise in Databricks platform development.
• Proficiency in Apache Spark for large-scale data processing.
• Hands-on experience with Delta Lake for data management.
• Strong understanding of data lake and warehouse architectures.
• Ability to design both batch and streaming data pipelines.

Preferred Skills

• Experience optimizing complex distributed systems.

Key Skills

Education

Any Graduate