Description

Build and maintain large-scale data warehousing solutions and ETL pipelines.

Responsibilities

• Convert SQL stored procedures into Python code using the PySpark DataFrame framework.
• Design and develop SQL Server stored procedures, functions, views, and triggers for ETL processes.
• Write and maintain technical documentation for ETL processes using process flow diagrams.
• Collaborate with business users, support teams, and developers to resolve data warehouse issues.
• Work within Agile project frameworks to deliver data transformations.

Required Skills

• 7+ years of experience with data warehouse technical architectures, ETL/ELT, and reporting tools.
• 4+ years of experience in Databricks, PySpark, and Python project development.
• 4+ years of experience working in very large data warehousing environments.
• Strong hands-on experience with Python or Scala.
• Expertise in Big Data ecosystems including HDFS and Spark.
• Hands-on experience with Azure Data Factory.
• Proficiency in SQL Server development and relational databases.
• Any Graduate degree.

Preferred Skills

• Experience with direct customer interaction and professional communication.

Key Skills

Education

Any Graduate