Description

Senior Data Engineer responsible for designing and developing scalable batch and streaming data pipelines, data lake architectures, and data warehousing solutions on the Databricks platform.

Responsibilities

• Design and develop scalable batch and streaming data pipelines.
• Build and maintain data lake architectures and data warehousing solutions.
• Implement Databricks Lakehouse concepts to optimize data processing.
• Ensure data integrity and performance across distributed systems.

Required Skills

• 8+ years of experience in data engineering roles.
• Expertise in Databricks platform development.
• Proficiency in Apache Spark for large-scale data processing.
• Hands-on experience with Delta Lake for data management.
• Strong understanding of data lake and warehouse architectures.
• Ability to design both batch and streaming data pipelines.

Key Skills

Education

Any Graduate