Description

Lead the engineering of data pipelines and ETL workflows for Transaction Monitoring systems. This role is on-site.

Responsibilities

• Design and implement efficient ETL workflows to extract, transform, and load data.
• Execute data validation and cleansing techniques to ensure data integrity.
• Collaborate with architects and developers to build scalable, sustainable data solutions.
• Troubleshoot technical issues to optimize data flows and system performance.
• Ensure all engineering work adheres to industry standards and best practices.

Required Skills

• 14+ years of experience in data engineering and ETL design.
• Expertise in building complex data pipelines and workflows.
• In-depth knowledge of the Hadoop ecosystem, including HDFS, Hive, and MapReduce.
• Proficiency in HiveQL for managing data in Hadoop-based warehouses.
• Hands-on experience with Big Data technologies for large-scale processing.
• Experience deploying data solutions on AWS and GCP.
• Knowledge of data governance, compliance, and financial crime detection systems.
• Familiarity with agile methodologies and version control tools like Git and Jenkins.

Preferred Skills

• Bachelor's degree in Computer Science, Engineering, or a related field.

Key Skills

Education

Any Graduate