Description

· Required Hard and Soft Skills / Experience

· Deep Expertise in PySpark, including performance tuning and optimization

· Strong python development experience in large-scale distributed environment

· Solid knowledge of Hadoop ecosystem (HDFS,Hive/Impala, YARN)

· Proven experience designing and governing enterprise, regulatory facing data platforms.

· Expertise in designing data lakes, ELT/ETL pipelines, batch and real time data processing solution

· Proficiency in programming languages such as Java, Scala and SQL

· Strong understanding of non-functional requirements and production support models

· Clear written and verbal communication skills with ability to influence across organizations

Key Skills

Education

Bachelor's degree