Description

Lead the design and development of scalable data engineering solutions using Databricks and PostgreSQL.

This role is remote.

Responsibilities

• Build and maintain ETL/ELT pipelines for batch and large-scale data processing.
• Develop data transformation workflows using SQL, Python, PySpark, and Databricks notebooks.
• Design and optimize PostgreSQL databases, schemas, tables, views, functions, and stored procedures.
• Implement database version control and automated schema deployment using Liquibase.
• Conduct code reviews, troubleshoot production issues, and provide technical guidance to the team.

Required Skills

• 12+ years of experience in data engineering or data platform development.
• Advanced hands-on experience with Databricks.
• Strong experience with PostgreSQL and database optimization.
• Proficiency in SQL, Python, PySpark, and Spark SQL.
• Experience building ETL/ELT pipelines and cloud-based data platforms.
• Strong understanding of data warehousing, lakehouse architecture, and data modeling.
• Experience implementing CI/CD processes for data pipelines and database changes.
• Bachelor's degree in a relevant field.

Preferred Skills

• Experience with Delta Lake and Databricks Workflows.
• Experience with AWS, Azure, or GCP cloud data services.

Key Skills

Education

Bachelor's degree