Description

You will be a Data Engineer responsible for designing and implementing data pipelines.

Responsibilities

• Build, configure, and manage Apache NiFi processors, templates, and flows for data automation.
• Develop and execute tests, analyze data, identify defects, and implement fixes across data systems.
• Integrate various systems using REST and SOAP services where necessary.
• Manage data flow automation using tools like Apache NiFi and Apache Airflow.

Required Skills

• 10+ years of hands-on experience in data engineering.
• Proficiency in Python scripting and Java 11, including Spring Boot, Spring Core, JPA, and Hibernate.
• Strong expertise with Apache NiFi, including custom processors and controller services.
• Experience with Apache Kafka, brokers, topics, partitions, and replication.
• Familiarity with CI/CD pipelines and version control (Git).
• Experience with Agile Scrum in live project environments.
• Knowledge of Data Warehousing or Data Mart concepts.
• Familiarity with cloud platforms (AWS, GCP, Azure) and on-premise environments.
• Proficiency in scripting languages such as Groovy, Jython, or JavaScript.

Preferred Skills

• Experience with Kafka Connect, Schema Registry, and Kafka Streams.
• Exposure to Data Lakes and the Banking domain, specifically Treasury.

Key Skills

Education

Any Graduate