Description

You will build and manage data pipelines within the Azure ecosystem, focusing on workflow orchestration and transformation logic.

This role is hybrid.

Responsibilities

• Develop and maintain data workflows using Azure Data Factory (ADF).
• Manage data processing tasks and scheduling using Control-M.
• Implement data transformations and processing logic within Azure environments.
• Ensure reliable data flow across cloud and on-premise systems.

Required Skills

• 5+ years of experience in data engineering roles.
• Hands-on experience with Azure Cloud services.
• Proficiency with Azure Data Factory (ADF).
• Experience working with databases (DB).
• Working knowledge of Spark.
• Experience with Databricks.
• Familiarity with Control-M.
• Experience with NoSQL databases including HBase, Mongo, or Teradata.

Preferred Skills

• Experience with Scala or Python for data processing.
• Knowledge of Pig scripts, Hive QL, or Sqoop.
• Experience developing MapReduce programs using Java or Python on Hadoop clusters.

Key Skills

Education

Any Graduate