Description

Build and maintain complex data integration solutions using Apache NiFi and modern microservices.

This role is on-site.

Responsibilities

• Design and implement data flow solutions in NiFi, defining sources, destinations, and transformations.
• Manage data ingestion from diverse sources (files, databases, APIs) and transform data formats.
• Configure NiFi to route and enrich data streams with necessary metadata.
• Maintain and optimize NiFi clusters, handling configuration and troubleshooting.
• Develop and integrate Java microservices to support data conditioning and validation.

Required Skills

• 10+ years of professional software development experience.
• Strong expertise in Apache NiFi architecture, processors, and data flow management.
• Proficiency in Java and Spring Boot for building API microservices.
• Deep knowledge of Kafka for event-driven and streaming architectures.
• Expertise in Airflow, including DAG development and scheduler/executor management.
• Familiarity with SQL and database data manipulation.
• Ability to ensure data flows are scalable and performant under varying load.

Key Skills

Education

Any Graduate