Description

You will design, build, and maintain high-throughput data ingestion pipelines using Apache NiFi. You own the reliability, performance, and security of streaming workflows in production environments.

Responsibilities

• Develop custom NiFi processors and manage data flows using NiFi and NiFi Registry.
• Configure and administer NiFi installations to ensure operational readiness for production.
• Optimize pipeline performance and throughput based on processing behavior and volume requirements.
• Implement security principles to protect data flows and enforce access controls.
• Troubleshoot production issues and resolve pipeline failures to maintain system reliability.

Required Skills

• Strong hands-on experience with Apache NiFi for building and managing data ingestion pipelines.
• Ability to design scalable data flow pipelines using NiFi and NiFi Registry.
• Experience with high-throughput, real-time data processing using Apache Kafka.
• Understanding of distributed data systems and stream processing frameworks, including Apache Storm.
• Experience configuring and maintaining NiFi environments for production readiness.
• Knowledge of performance tuning, monitoring, and optimization for large-scale data volumes.
• Familiarity with DevOps practices and Agile/Scrum methodologies.
• Strong problem-solving skills and attention to detail in complex data workflows.
• 5+ years of relevant experience.

Preferred Skills

• Experience collaborating effectively in cross-functional teams with clear communication.

Key Skills

Education

Any Graduate