Description

You will build and manage data pipelines within the Azure ecosystem, focusing on workflow orchestration and transformation logic.

Responsibilities

• Develop and maintain data workflows using Azure Data Factory (ADF).
• Manage data processing tasks and scheduling using Control-M.
• Implement data transformations and processing logic within Azure environments.
• Work with various database technologies to support data engineering requirements.
• Ensure reliable data flow across cloud and on-premise systems.

Required Skills

• 5+ years of experience in data engineering roles.
• Hands-on experience with Azure Cloud services.
• Proficiency with Azure Data Factory (ADF).
• Experience working with databases (DB).
• Working knowledge of Spark.
• Experience with Databricks.
• Familiarity with Control-M.
• Experience with NoSQL databases including HBase, Mongo, or Teradata.
• Degree in any graduate field.

Preferred Skills

• Experience with Scala or Python for data processing.
• Knowledge of Pig scripts, Hive QL, or Sqoop.
• Experience developing MapReduce programs using Java or Python on Hadoop clusters.

Key Skills

Education

Any Graduate