Description

You will design and build end-to-end enterprise big data solutions and frameworks from scratch.

Responsibilities

• Design and implement data pipeline frameworks from the ground up.
• Develop complex data ingestion and transformation pipelines for structured and semi-structured data.
• Manage CI/CD processes, stories, bugs, and issues using Azure DevOps.
• Build and maintain end-to-end data pipelines within an agile team environment.

Required Skills

• 8+ years of experience developing enterprise big data solutions.
• 5+ years of experience working specifically with the Microsoft Azure data platform.
• Hands-on experience with Azure Databricks, Azure Data Factory, and Azure Data Lake Storage.
• Proficiency in advanced SQL programming.
• Experience with Azure DevOps, Azure Functions, and Azure Cloud Services.
• Strong knowledge of ETL processes and shell scripting.
• Experience handling SFTP integrations.
• Ability to work within an agile development lifecycle.

Preferred Skills

• Experience with Snowflake or Kafka.
• Background in the retail industry.

Key Skills

Education

ANY GRADUATE