Description

You will design and implement data pipelines and orchestration workflows within the Microsoft Azure ecosystem.

Responsibilities

• Design, build, and maintain scalable data pipelines using Azure Data Factory and Databricks.
• Ingest and transform data from Oracle and PostgreSQL sources.
• Optimize performance of data workflows and cloud data flows.
• Implement data quality checks, lineage tracking, and monitoring processes.
• Collaborate with analysts and scientists to deliver clean, reliable data.

Required Skills

• 5+ years of experience in data engineering.
• Hands-on expertise with Azure Data Factory.
• Proficiency with Azure Databricks (PySpark or Scala).
• Strong working knowledge of Oracle and PostgreSQL databases.
• Ability to write efficient SQL queries.
• Experience building ETL/ELT workflows and data orchestration on Azure.
• Experience with Azure storage solutions including Blob Storage and ADLS Gen2.
• Understanding of data modeling, warehousing concepts, and performance optimization.
• Any Graduate degree.

Preferred Skills

• Familiarity with CI/CD pipelines in Azure DevOps.

Key Skills

Education

Any Graduate