Description

You will design, build, and maintain data pipelines and storage solutions on Azure.

This role is on-site.

Responsibilities

• Design and maintain data pipelines using Azure Data Factory, handling XML and JSON transformations.
• Implement and manage data storage in Azure Data Lake, optimizing XML and JSON structures.
• Process large datasets with Azure Databricks, focusing on data manipulation and transformation.
• Integrate external data sources via APIs, ensuring proper XML and JSON interchange.
• Ensure data quality through validation checks and error handling.

Required Skills

• 5+ years of experience with Azure Data Factory, Azure Data Lake, and Databricks.
• Proficiency in XML and JSON schema definition and transformation.
• Strong knowledge of Data Modeling and Data Warehousing concepts.
• Experience with SQL, Python, or Scala for data manipulation.
• Familiarity with API development involving XML and JSON exchange.
• Understanding of data governance, security, and compliance standards.
• Proven experience in data pipeline development and maintenance.

Key Skills

Education

Any Graduate