Description

You will build and maintain data pipelines using Azure Databricks and PySpark.

Responsibilities

• Develop data processing workflows using Python and PySpark within Azure Databricks.
• Write and optimize PL/SQL for data warehousing tasks.
• Manage data integration and transformation processes.
• Automate tasks using Unix shell or Perl scripting.

Required Skills

• 5+ years of experience in data engineering.
• Hands-on expertise with Azure Databricks.
• Proficiency in Python and PySpark.
• Strong knowledge of PL/SQL.
• Experience with Unix shell or Perl scripting.
• Solid understanding of Java or Object-Oriented programming concepts.
• Experience working with Data Warehouse architectures.
• Bachelor's degree or equivalent graduate qualification.

Preferred Skills

• Prior experience in financial banking IT and product knowledge.
• Experience with MS SSIS or SSAS.

Key Skills

Education

Any Gradute