Description

You will design, develop, and maintain data pipelines.

Responsibilities

• Design and maintain data pipelines using Azure Data Factory, handling XML and JSON data transformations.
• Implement and manage data storage solutions in Azure Data Lake, optimizing XML and JSON data structures.
• Process and transform large datasets using Azure Databricks, focusing on XML and JSON manipulation.
• Integrate external data sources via APIs, ensuring proper XML and JSON interchange.
• Ensure data quality by implementing validation checks and error handling for XML and JSON data.

Required Skills

• 5+ years of experience with Azure Data Factory, Azure Data Lake, and Databricks.
• Proficiency in working with XML and JSON data formats, including schema definition and transformation.
• Strong knowledge of Data Modeling and Data Warehousing concepts.
• Experience with SQL, Python, or Scala for data manipulation.
• Familiarity with API development, particularly involving XML and JSON exchange.
• Understanding of data governance, security, and compliance standards.
• Experience with data pipeline development and maintenance.

Key Skills

Education

Any Graduate