Description

You will design, implement, and maintain scalable data solutions and pipelines on the Azure platform.

Responsibilities

• Design and implement ETL processes and data pipelines using Azure Data Factory and Azure Databricks.
• Develop and maintain data models, data warehouses, and data lakes on Azure.
• Optimize data storage and retrieval for performance and scalability.
• Monitor and troubleshoot data workflows to ensure data quality and reliability.
• Document data processes, architecture, and data flows for compliance and knowledge sharing.

Required Skills

• 4+ years of experience building and optimizing data pipelines.
• Proficiency with Azure Data Factory, Azure Data Lake, and Azure Databricks.
• Strong experience conducting SQL transformations and ETL processes.
• Ability to code in Python and Scala within Azure Databricks.
• Experience extracting data from multiple sources, including applications and APIs.
• Experience loading and managing data within Azure SQL Database.
• Bachelor's degree.

Key Skills

Education

Bachelor's degree