Description

You will develop and manage scalable data processing workflows using Databricks.

Responsibilities

• Build and maintain scalable data processing workflows within Databricks.
• Manage and optimize data processing clusters.
• Implement data ingestion processes, ideally using APIs.
• Develop SQL-based transformations using DBT where applicable.

Required Skills

• 5+ years of professional experience.
• Proficiency in Databricks and PySpark.
• Strong understanding of APIs for data ingestion.
• Experience with SQL for data transformation.
• Familiarity with CI/CD pipelines and automated testing.
• Ability to manage the lifecycle of machine learning models.

Key Skills

Education

Any Gradute