Description

You will build and maintain data platforms for warehouse and manufacturing domains within the supply chain space.

Responsibilities

• Design and implement data pipelines for high-throughput ingestion, transformation, and storage.
• Optimize data processing workflows for performance and scalability within Azure cloud environments.
• Monitor and troubleshoot pipeline failures to ensure reliability and minimal downtime.
• Draft architectural diagrams, interface specifications, and technical design documents.
• Lead analysis of the technology environment to identify deficiencies and recommend improvements.

Required Skills

• 5+ years of experience in data engineering.
• Expertise in Azure Databricks for building and optimizing data pipelines.
• Experience with Azure Synapse Analytics for data warehousing and analytics.
• Strong proficiency in SQL for data querying and manipulation.
• Programming experience in Python and PySpark for data processing and transformation.
• Experience with distributed computing frameworks.
• Familiarity with Azure Blob Storage and Azure Data Lake Storage.
• Knowledge of data modeling, ETL processes, and data security best practices.

Preferred Skills

• Bachelor’s Degree.

Key Skills

Education

Bachelor’s Degree