Description

You will act as the lead developer for large-scale data processing initiatives.

Responsibilities

• Develop and optimize Spark-based data processing pipelines.
• Collaborate with data engineers and data scientists to design data solutions.
• Write efficient, scalable code for processing large datasets.
• Monitor and troubleshoot performance issues in Spark applications.
• Ensure data quality and integrity throughout the processing pipelines.
• Implement and enforce best practices in Spark development.

Required Skills

• 10+ years of experience in data engineering or related fields.
• Apache Spark.
• Scala.
• Java.
• Hive.
• ETL processes.
• Hadoop.
• Data Integration.
• Distributed Systems.
• Performance Tuning.

Preferred Skills

• Experience in the Banking and Financial Services industry.
• Knowledge of capital management, liquidity management, and payments processes.

Key Skills

Education

Bachelor's degree