Description

You will design and build real-time and batch data pipelines using Apache NiFi.

Responsibilities

• Build and configure ETL/ELT data workflows for large-scale data processing.
• Develop custom NiFi processors and scripts for specialized data transformations.
• Monitor and optimize data flows for performance, reliability, and scalability.
• Integrate data from databases, APIs, and streaming platforms.
• Troubleshoot and resolve issues in production NiFi environments.

Required Skills

• 5+ years of hands-on experience with Apache NiFi (designing, managing, and maintaining data flows).
• Proficiency in Java for custom scripting and processor development.
• Experience with ETL/ELT processes and SQL.
• Knowledge of Big Data technologies including Apache Kafka, Apache Spark, and Hadoop.
• Experience with Cloud Platforms (AWS or Azure).

Preferred Skills

• Experience working with Linux environments.
• Familiarity with containerization technologies such as Docker and Kubernetes.

Key Skills

Education

Any Gradute