Description

You build and maintain scalable data pipelines and data solutions using the Databricks platform on cloud services.

Responsibilities

• Design and develop data solutions using Databricks, Delta Lake, and Unity Catalog.
• Optimize batch and streaming data pipelines for performance.
• Implement data quality, security, and governance frameworks.
• Collaborate with data scientists and analysts on big data and AIML initiatives.
• Troubleshoot performance issues and document technical specifications.

Required Skills

• 5+ years of experience in data engineering.
• Expertise in Databricks and Spark.
• Proficiency with ETL/ELT pipeline development.
• Experience with AWS, Azure, or GCP.
• Strong understanding of Delta Lake architecture.
• Familiarity with data modeling and cloud infrastructure design.

Key Skills

Education

Any Gradute