Description

Build and maintain data pipelines and reporting structures within an Azure environment.

Responsibilities

• Develop data processing workflows using Databricks and PySpark.
• Design and manage SQL-based data structures for business intelligence and reporting.
• Implement data solutions leveraging Azure Synapse and Azure ML.
• Maintain data integrity across cloud-based data engineering pipelines.

Required Skills

• 10+ years of experience in data engineering, business intelligence, and reporting.
• Expertise in Databricks and PySpark.
• Proficiency in Python and SQL.
• Hands-on experience with MS Azure.
• Experience with Azure Synapse.
• Experience with Azure ML.
• Bachelor's degree in a relevant field.

Preferred Skills

• Experience with Google Cloud Platform.
• Understanding of Kafka streaming.

Key Skills

Education

Bachelor's degree