Description

You will design, implement, and maintain scalable data pipelines and workflows in Azure. You will build and optimize data storage solutions using Azure Data Lake, Blob Storage, SQL Data Warehouse, and Cosmos DB. You will develop data models and optimize data architecture for performance and scalability. You will collaborate with data scientists and stakeholders to gather requirements. You will ensure data security, governance, and compliance within the Azure environment. You will automate data processing tasks using Azure Data Factory, Databricks, and Synapse Analytics. You will monitor system performance and troubleshoot issues. You will stay current with Azure data services and emerging cloud technologies.

Responsibilities

• Design and maintain scalable data pipelines in Azure.
• Build and optimize data storage solutions using Azure Data Lake and SQL Data Warehouse.
• Automate data processing using Azure Data Factory and Databricks.
• Ensure data security, governance, and compliance.
• Troubleshoot system performance issues.

Required Skills

• 5+ years experience as a Data Engineer or similar role.
• Strong proficiency in Azure Data Factory, Data Lake, Synapse, and Databricks.
• Proficiency in SQL, Python, Spark, or Scala.
• Experience with data pipeline and workflow orchestration.
• Knowledge of Data Governance, Security, and Compliance in Azure.
• Bachelor's or Master's degree in Computer Science, Data Science, or related field.

Preferred Skills

• Experience with big data tools and frameworks.
• Familiarity with DevOps practices for data engineering.
• Azure Data Engineer certification.

Key Skills

Education

Bachelor's or Master's degrees