Description

Own end-to-end data engineering initiatives using Azure Databricks, PySpark, and Python to build scalable data solutions.

This role is remote.

Responsibilities

• Design and implement ETL/ELT pipelines and orchestration workflows on Azure Databricks.
• Develop high-performance batch and streaming data processing solutions using PySpark.
• Optimize data warehousing structures and data models for efficiency and scalability.
• Manage data ingestion frameworks, Delta Lake, and Parquet formats.

Required Skills

• 10+ years of total IT experience with 5+ years in Azure cloud technologies.
• Strong expertise in Azure Databricks, PySpark, Python, and SQL.
• Proven experience with ETL/ELT pipelines, data warehousing, and data modeling.
• Deep understanding of data engineering concepts, including batch and streaming processing.
• Knowledge of Delta Lake and Parquet file formats.
• Experience with Work Force Management systems is a plus.
• Strong stakeholder management and problem-solving capabilities.

Preferred Skills

• Experience with advanced data modeling and optimization techniques.
• Background in Work Force Management domain.

Key Skills

Education

Any Graduate