Description

You will design, implement, and maintain data pipelines and infrastructure within Azure cloud environments.

Responsibilities

• Design, develop, and maintain ETL pipelines to move data from on-premises sources to Azure using ADF and Event Hub.
• Integrate diverse data sources, including databases, APIs, and streaming data, into structured formats.
• Deploy and manage data infrastructure and services using the Azure cloud platform.
• Apply data transformation and cleansing techniques to ensure accuracy and consistency.
• Monitor pipelines and infrastructure to proactively address performance bottlenecks.

Required Skills

• Hands-on experience with Azure cloud platform, specifically Azure Data Factory (ADF) and Event Hub.
• Proven experience migrating data from on-premises sources to Azure.
• Proficiency in Python, Java, or Scala for data processing and scripting.
• Strong knowledge of relational and NoSQL databases.
• Experience with SQL query optimization.
• Experience using cloud-native ETL services.
• Proficiency with Git for version control.
• Bachelor's degree in Computer Science, IT, or a related field.

Preferred Skills

• Azure cloud platform certifications.
• Master's degree in a technical field.

Key Skills

Education

Any graduate