Description

You will work with Databricks and Spark to manage data pipelines and governance.

Responsibilities

• Build and maintain data pipelines using Spark and Delta Lake.
• Implement data governance and quality controls via Unity Catalog.
• Perform performance tuning to optimize data processing workflows.
• Execute ETL processes and ensure data integrity through testing.

Required Skills

• 5+ years of experience in data engineering or related roles.
• Proficiency with Databricks and Spark (PySpark or Scala).
• Hands-on experience with Delta Lake and Unity Catalog.
• Strong SQL and Python programming skills.
• Experience working within cloud platforms (AWS, Azure, or GCP).
• Solid understanding of ETL development and data quality testing.
• Background in business analysis or data pipeline architecture.
• Degree in any graduate field.

Key Skills

Education

Any Graduate