Description

You will migrate Python-based ETL jobs to Databricks.

Responsibilities

• Migrate existing Looker views to Spark ETL jobs running on Databricks.
• Update corresponding Data Lake tables via regular ETL job execution.
• Collaborate with the team to perform QA on new tables.
• Ensure data quality across all migrated pipelines.

Required Skills

• 4+ years of experience in data engineering.
• Proficiency with PySpark and Python.
• Hands-on experience with Databricks.
• Strong SQL skills for data manipulation.
• Experience working within AWS environments.
• Understanding of Data Warehouse (DWH) concepts.

Preferred Skills

• Bachelor's degree in Computer Science.
• Effective communication skills.

Key Skills

Education

Bachelor's degree in Computer Science