Description

You will own data ingestion and processing workflows within the Azure ecosystem, bridging on-premises sources with cloud infrastructure.

Responsibilities

• Build data ingestion pipelines from on-premises sources including mainframe, SQL Server, and Oracle.
• Develop and maintain data processing logic using Azure Databricks and Spark.
• Orchestrate complex data workflows using Autosys or Oozie.
• Execute source-code versioning and promotion using Git and Jenkins.

Required Skills

• Minimum 15 years of professional experience.
• Azure certification in Azure Data Engineer or Azure Data Factory.
• Expertise in Azure Databricks Spark using PySpark, Scala, or SQL.
• Strong programming skills in Python, Scala, or Java.
• Advanced SQL proficiency in T-SQL or PL-SQL.
• Experience with Sqoop and Hadoop.
• Hands-on experience with Azure ingestion from on-premises environments.
• Proficiency with Git for version control.

Preferred Skills

• Experience working with mainframe files.
• Experience in Agile environments using JIRA and Confluence.

Key Skills

Education

Not specified