Description

You will design, implement, and maintain scalable data pipelines and workflows in Azure, ensuring data security and governance across the environment.

Responsibilities

• Design and maintain scalable data pipelines using Azure Data Factory, Databricks, and Synapse Analytics.
• Build and optimize data storage solutions using Azure Data Lake, Blob Storage, SQL Data Warehouse, and Cosmos DB.
• Develop data models and optimize data architecture for performance and scalability.
• Automate data processing tasks and monitor system performance to troubleshoot issues.
• Collaborate with data scientists and stakeholders to gather requirements and ensure compliance.

Required Skills

• 5+ years of experience as a Data Engineer with cloud data platforms.
• Strong proficiency in Azure data services including Data Factory, Data Lake, Synapse, Databricks, and SQL.
• Proficiency in SQL, Python, Spark, or Scala.
• Experience with data pipeline and workflow orchestration.
• Knowledge of Data Governance, Security, and Compliance in Azure.
• Bachelor's or Master's degree in Computer Science, Data Science, or related field.

Preferred Skills

• Experience with big data tools and frameworks.
• Familiarity with DevOps practices for data engineering.
• Certifications in Azure Data Engineer or similar.

Key Skills

Education

Bachelor's or Master's degrees