Description

You will design and implement data solutions on Databricks to support organizational analytics.

Responsibilities

• Design data solutions including Delta Lake, data warehouses, and data marts.
• Develop and manage ETL pipelines for both streaming and batch processing.
• Build and maintain data pipelines covering collection, storage, and access.
• Apply logical and physical data modeling best practices.
• Conduct discovery exercises and develop proof of concepts for stakeholders.

Required Skills

• 5+ years of experience in data engineering roles.
• Proficiency with PySpark and Python.
• Strong SQL skills.
• Experience with AWS services including Glue, S3, Redshift, and Lambda.
• Hands-on experience with Databricks environments.
• Ability to implement data modeling and ETL workflows using cloud-based services.
• Degree in any graduate field.

Preferred Skills

• Experience with Collibra for data quality and governance.
• Knowledge of dbt for modeling and building layers in Databricks.

Key Skills

Education

Any Graduate