Description

You will own data engineering tasks within Databricks environments across Azure and AWS.

Responsibilities

• Write PySpark code and develop notebooks for data processing.
• Manage Databricks compute, clusters, and Delta Lake implementations.
• Build and configure workflows and jobs within Databricks.
• Execute ETL processes and support data migration journeys.
• Optimize Spark jobs to resolve performance issues.

Required Skills

• 5+ years of professional experience in data engineering.
• Extensive hands-on experience with Databricks.
• Proficiency in PySpark coding and notebook development.
• Strong understanding of Delta Lake and Databricks compute.
• Experience managing Databricks clusters and workflows.
• Knowledge of AWS services including S3 and IAM.
• Ability to perform performance tuning and optimization.
• Degree in any graduate field.

Key Skills

Education

Any gradudate