Description

You will own the development and maintenance of the data foundation across platforms.

Responsibilities

• Design and optimize scalable data pipelines integrating Databricks and relational metadata stores like PostgreSQL.
• Develop efficient ETL workflows using Python.
• Improve performance and cost efficiency of Databricks jobs.
• Implement best practices for schema evolution, data quality, and governance.
• Support data migration activities, validation, and performance enhancements.

Required Skills

• 5+ years of experience in Data Engineering.
• Expert proficiency in Python for ETL development.
• Experience with Databricks environments.
• Knowledge of Data Operations principles.
• Familiarity with relational metadata stores (e.g., PostgreSQL).
• Understanding of Data Quality frameworks.
• Experience with general Data pipelines.

Key Skills

Education

Not specified