Description

Design, build, and maintain data-based structures and systems to support Data and Analytics use cases.

Responsibilities

• Build data pipelines to collect, arrange, and manage data storage in the big data environment.
• Develop robust, testable programs for moving, transforming, and loading data using Spark.
• Design and deploy frameworks and microservices to serve data assets to consumers.
• Partner with Data Scientists, Data Modelers, and Technical partners to construct strategic data stores.
• Collaborate with stakeholders to translate customer needs into data design requirements and ensure data quality.

Required Skills

• 8+ years of data-oriented experience managing data and analytics resources.
• Experience with orchestration tools such as Airflow, Argo, or Luigi.
• Proficiency in CI/CD, Docker, and Kubernetes.
• Experience with No-SQL databases: HBase, Cassandra, or MongoDB.
• Knowledge of streaming technologies: Kafka, Flink, or Spark Streaming.
• Strong background in Hadoop ecosystem and building data assets at enterprise scale.
• Bachelor's degree in a technical or business-related field.

Preferred Skills

• Prior banking or financial services experience.
• Background in Big Data Engineering and Advanced Data Analytics.

Key Skills

Education

Bachelor's degree