Description

You will build and maintain data pipelines to enable efficient data ingestion and analysis.

This role is on-site.

Responsibilities

• Build and maintain ELT/ETL pipelines using Microsoft Fabric tools for data ingestion.
• Apply transformations, cleanse, and enrich data for reporting and analysis.
• Handle large datasets, optimizing storage and retrieval for performance.
• Implement automation for data processing and integration workflows.
• Partner with report developers to ensure data usability.

Required Skills

• 9+ years of Data Engineering experience.
• Expertise in Data Factory (Fabric) for designing and orchestrating data pipelines.
• Proficiency with Spark (PySpark, Spark SQL, Scala) for complex data processing on OneLake.
• Experience creating and managing Lakehouse structures (Delta tables, files) in OneLake.
• Strong understanding of OneLake / ADLS Gen2, including Delta Lake format and partitioning.
• Experience with monitoring pipeline runs and Spark job performance.
• Familiarity with ETL/ELT patterns.
• Experience with Azure or AWS cloud environments.
• Bachelor’s degree in Computer Science, Engineering, or a relevant field.

Preferred Skills

• Experience with the Manufacturing domain.
• Azure/AWS Cloud Certifications.

Key Skills

Education

Bachelor's degree