Description

You will design and implement data flow solutions using NiFi.

Responsibilities

• Create and implement data flow solutions, defining data sources, destinations, and transformation processes.
• Manage data ingestion from various sources (files, databases, APIs) and transform data for downstream consumption.
• Configure NiFi to route data to appropriate destinations and enrich it with necessary information.
• Maintain and improve NiFi clusters, handling configuration, optimization, and troubleshooting.
• Develop and integrate microservices to support data conditioning, validation, and transformation.

Required Skills

• Strong expertise in NiFi architecture, processors, and data flow management.
• 10+ years of experience in data integration and ETL processes.
• Proficiency in Java or Python scripting.
• Familiarity with SQL and data modeling concepts.
• Experience with AWS, Azure, or GCP cloud platforms integrated with NiFi.
• Knowledge of big data technologies such as Kafka.

Key Skills

Education

Any Graduate