Description

You design, build, and maintain scalable data solutions and pipelines using the Databricks platform on cloud infrastructure.

Responsibilities

• Design and develop data solutions using Databricks, Delta Lake, and Unity Catalog.
• Optimize batch and streaming data pipelines for performance and reliability.
• Implement data quality, security, and governance frameworks.
• Troubleshoot performance issues and document technical specifications.
• Collaborate with data scientists and analysts on big data and AI/ML initiatives.

Required Skills

• 5+ years of experience in data engineering.
• Expertise in Databricks and Spark.
• Proficiency with ETL/ELT pipeline development.
• Experience with AWS, Azure, or GCP.
• Strong understanding of Delta Lake architecture.
• Familiarity with data modeling and cloud infrastructure design.

Preferred Skills

• Experience with Unity Catalog for data governance.
• Background in AI/ML data preparation.

Key Skills

Education

Any Gradute