Description

You will lead data engineering efforts within an Azure environment to design, build, and optimize scalable data pipelines and architectures.

Responsibilities

• Design and implement relational and dimensional data models within Azure SQL Database.
• Build and orchestrate ETL/ELT workflows and data integration processes using Azure Data Factory.
• Develop and optimize complex SQL queries for data transformation, aggregation, and analysis.
• Manage deployments and resource orchestration using Azure DevOps CI/CD pipelines and GitHub.

Required Skills

• 5+ years of experience in data engineering or related roles.
• Proficiency in SQL and Python for data manipulation, including Pandas and NumPy.
• Hands-on experience with Azure SQL Database and Azure Data Factory.
• Experience with Azure Synapse Analytics and Azure Blob Storage.
• Practical knowledge of data modeling and ETL methodologies.
• Experience with file formats including JSON and Parquet.
• Proficiency in using Azure DevOps CI/CD pipelines.
• Version control experience using GitHub.

Preferred Skills

• Experience with Azure Databricks, Azure Stream Analytics, and Azure Functions.
• Knowledge of API integration and multi-cloud platforms including AWS and GCP.

Key Skills

Education

ANY GRADUATE