Description

You will build and manage data pipelines using Databricks and Azure environments.

This role is hybrid.

Responsibilities

• Develop Databricks Notebooks using PySpark and Spark SQL.
• Create Unity Catalog tables and manage Delta versioning concepts.
• Build and manage workflows within Databricks.
• Execute data transfers from Databricks to Snowflake.
• Migrate on-premise and legacy mainframe jobs to Azure.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency in PySpark and Spark SQL.
• Hands-on experience with Databricks and Delta Lake.
• Experience managing Unity Catalog tables.
• Practical knowledge of Snowflake.
• Experience working within Azure environments.
• Bachelor’s degree in Computer Science, IT, Engineering, or related field, or equivalent experience.

Preferred Skills

• Ability to migrate data from on-premise systems to the cloud.
• Willingness to travel or relocate to various client locations throughout the U.S.

Key Skills

Education

Any Graduate