Description

You will build and maintain large-scale data processing solutions using distributed computing frameworks.

This role is on-site.

Responsibilities

• Build and optimize data pipelines using Python or Scala with PySpark and Spark.
• Manage data ingestion and processing workflows using Sqoop, Hive, Impala, and Oozie.
• Implement data models to support efficient large-scale data processing requirements.
• Maintain and troubleshoot distributed data systems to ensure reliability and performance.

Required Skills

• 5+ years of experience in big data development.
• Proficiency in Python or Scala programming languages.
• Hands-on experience with PySpark and Spark distributed computing frameworks.
• Experience with Sqoop for data transfer between relational databases and Hadoop.
• Knowledge of Hive and Impala for data warehousing and SQL queries.
• Familiarity with Oozie for workflow scheduling and coordination.

Preferred Skills

• Experience with data modeling techniques.
• Background in financial services, specifically AML (Anti-Money Laundering) or Anti-Financial Crime domains.

Key Skills

Education

Any Graduate