Description

You will design, implement, and maintain scalable data pipelines and workflows in Azure. You will build and optimize data storage solutions and ensure data security and governance across the environment.

Responsibilities

• Design and maintain scalable data pipelines using Azure Data Factory, Databricks, and Synapse Analytics.
• Build and optimize data storage solutions using Azure Data Lake, Blob Storage, SQL Data Warehouse, and Cosmos DB.
• Develop data models and optimize data architecture for performance and scalability.
• Automate data processing tasks and monitor system performance to troubleshoot issues.
• Collaborate with data scientists and stakeholders to gather requirements and ensure compliance.

Required Skills

• 5+ years of experience as a Data Engineer with cloud data platforms.
• Strong proficiency in Azure data services including Data Factory, Data Lake, Synapse, Databricks, and SQL.
• Proficiency in SQL, Python, Spark, or Scala.
• Experience with data pipeline and workflow orchestration.
• Knowledge of Data Governance, Security, and Compliance in Azure.
• Bachelor's or Master's degree in Computer Science, Data Science, or related field.

Preferred Skills

• Experience with big data tools and frameworks.
• Familiarity with DevOps practices for data engineering.
• Certifications in Azure Data Engineer or similar.

Key Skills

Education

Bachelor's or Master's degrees