Description

Build and maintain data pipelines and services within an Azure environment for the oil and gas domain.

Responsibilities

• Build data pipelines using Azure Synapse or Azure Data Factory with Python.
• Develop C# services and APIs that integrate with Azure services and tools.
• Maintain and support existing C# applications and systems utilizing Azure and APIs.
• Troubleshoot and debug C# code to resolve issues related to Azure and APIs.
• Coordinate with multiple project teams to deliver integrated solutions.

Required Skills

• 12+ years of professional experience in data engineering or software development.
• Proficiency in Azure Data Factory (ADF) and Azure Databricks.
• Strong experience with Spark SQL and PySpark.
• Hands-on experience with Azure Data Lake, Azure Blob Storage, and Azure Functions.
• Ability to develop in at least one modern language: Python, C#, Java, Go, or C++.
• Experience with Azure Database Migration Services.
• Proficiency with SQL or NoSQL databases and associated blob formats.
• Experience using CI tools such as Azure DevOps/VSTS and Git.
• Solid understanding of software development principles and best practices.

Key Skills

Education

Any Graduate