Description

You will build and manage data pipelines within the Azure ecosystem.

This role is on-site.

Responsibilities

• Design and implement data modeling and advanced SQL structures.
• Execute cloud migration methodologies using Azure Data Factory and Azure Functions.
• Develop ingestion and transformation logic for Avro, JSON, and CSV formats using PySpark.
• Manage infrastructure and deployment through DevOps processes and Terraform scripting.

Required Skills

• 13+ years of professional experience.
• Expert-level proficiency in SQL and Python.
• Hands-on experience with Databricks and Spark.
• Deep understanding of Azure data services.
• Experience with PySpark for data processing.
• Practical knowledge of Terraform and DevOps workflows.
• Experience handling varied data file formats including Avro, JSON, and CSV.

Key Skills

Education

Not specified