Description

You will design and maintain data pipelines and ecosystems within an Azure environment.

This role is hybrid.

Responsibilities

• Build and manage data lake and delta lake ecosystems.
• Process large volumes of data involving millions of records.
• Develop and maintain CI/CD pipelines for data workflows.
• Deliver data solutions within an Agile development environment.

Required Skills

• 5+ years of software development experience.
• Advanced proficiency in Python.
• In-depth experience with MS SQL Server and T-SQL.
• Hands-on experience with Azure Databricks and Azure Data Factory.
• Experience with big data technologies including Spark, Hadoop, and Kafka.
• Practical use of Infrastructure as Code tools like Terraform or Pulumi.
• Experience working with large-scale datasets.

Preferred Skills

• Knowledge of or experience working with .NET.

Key Skills

Education

Any Gradute