Description

You will build and maintain data pipelines using Azure Databricks.

Responsibilities

• Design and develop ETL pipelines from multiple data sources (CSV, XML, JSON, relational databases).
• Conduct code reviews and perform design reviews for data solutions.
• Manage offshore team collaboration and code quality.
• Review requirements and estimate work effort for data projects.

Required Skills

• 5+ years of experience in ETL development.
• 3+ years of hands-on experience with Azure Databricks.
• Advanced knowledge of ETL concepts.
• Strong proficiency in Python and PySpark.
• Experience with Azure, SQL, and MS SQL Server.
• Familiarity with JSON and XML data formats.
• Experience using Jira for tracking.
• Ability to translate user requirements into technical solutions.

Preferred Skills

• Understanding of ADF platform and framework.
• Experience with Informatica PC.

Key Skills

Education

Any Graduate