Description

Design and implement data pipelines using Apache NiFi and Airflow.

This role is hybrid.

Responsibilities

• Build and manage Apache NiFi processors, templates, and flows for data automation.
• Develop and execute tests, analyze data, and fix defects across data systems.
• Integrate systems using REST and SOAP services.
• Manage data flow automation with Apache NiFi and Airflow.
• Maintain CI/CD pipelines and version control using Git.

Required Skills

• 10+ years of hands-on experience in data engineering.
• Proficiency in Python scripting and Java 11 (Spring Boot, Core, JPA, Hibernate).
• Strong expertise with Apache NiFi, including custom processors and controller services.
• Experience with Apache Kafka (brokers, topics, partitions, replication).
• Familiarity with cloud platforms (AWS, GCP, Azure) and on-premise environments.
• Proficiency in scripting languages such as Groovy, Jython, or JavaScript.
• Knowledge of Data Warehousing or Data Mart concepts.

Preferred Skills

• Experience with Kafka Connect, Schema Registry, and Kafka Streams.
• Exposure to Data Lakes and the Banking domain, specifically Treasury.

Key Skills

Education

Any Graduate