Description

You will build and maintain data pipelines using Azure services, ingesting data from legacy sources and orchestrating workflows.

This role is on-site.

Responsibilities

• Ingest data from on-premises sources like mainframe, SQL Server, or Oracle into Azure.
• Develop ETL/ELT processes using Azure Data Factory and Azure Databricks with Spark.
• Manage data file movement, including processing data via mailbox mechanisms.
• Implement source code versioning and promotion using Git.
• Orchestrate data workflows using tools such as Autosys or Oozie.

Required Skills

• 7+ years of hands-on data engineering experience in a cloud environment (Azure, AWS, or GCP).
• Strong programming skills in Python, Scala, or Java.
• Expertise in SQL, specifically T-SQL or PL-SQL.
• Proficiency with Azure Data Factory and PySpark or Scala for Spark processing.
• Experience with data ingestion from legacy sources (mainframe, Oracle, SQL Server).
• Familiarity with big data tools like Sqoop/Hadoop.
• Experience using version control systems, specifically Git.

Key Skills

Education

Any Graduate