Description

Design, develop, and maintain scalable big data solutions and data pipelines within a complex financial environment.

This role is on-site.

Responsibilities

• Design and implement efficient big data solutions using Hadoop, Spark, Hive, and MapReduce.
• Develop and maintain data pipelines for the ingestion, processing, and analysis of large datasets.
• Write and optimize complex SQL queries for ETL processes.
• Use Java and Python for scripting, data processing, and application development.
• Troubleshoot performance bottlenecks and participate in code reviews.

Required Skills

• 12+ years of overall IT experience.
• 6-8 years of extensive experience with Hadoop ecosystem components including HDFS, MapReduce, Hive, and Spark.
• 6-8 years of proficiency in Java and Python with strong object-oriented programming principles.
• 6-8 years of strong SQL skills for data manipulation and querying.
• Proven experience working within the financial services or investment banking domain.
• Experience working in an Agile environment.

Preferred Skills

• Relevant certifications in Hadoop, Spark, or Java.

Key Skills

Education

Any Gradute