Description

Responsibilities:
Engineer will be part of the datastore-migration Factory team that will be responsible to perform for the end-to-end datastore migration from on-prem DataLake to AWS hosted LakeHouse. This is a high visibility and crucial project for Goldman Sachs.

Responsibilities of the Engineer includes:

Skill set one:-

Hands on programming Python, Pyspark.

Skills:- Apache Spark, Hadoop (HDFS/Hive), Sybase IQ, Shell scripting , Apache Iceberg , AWS Ecosystems for bigdata processing ( EMR, Redshift, Athena, Glue eic…), AWS Lamda expressions ,Step functions, CI/CD best practices & Kubernates deployment experience

Key Skills

Education

Any Gradute