Description

You will design, develop, and maintain ETL/ELT pipelines for batch and near-real-time data ingestion.

This role is on-site.

Responsibilities

• Build reusable, modular Apache NiFi flows with proper versioning, parameterization, and error handling.
• Integrate data from relational databases, flat files, APIs, message queues, and streaming platforms.
• Implement data transformation, enrichment, validation, and routing logic to maintain data quality.
• Monitor, troubleshoot, and optimize ETL workflows for performance and fault tolerance.
• Implement logging, monitoring, and alerting for all data pipelines.

Required Skills

• 4+ years of experience as a Data Engineer or ETL Developer.
• Strong hands-on experience with Apache NiFi, including processors, controller services, and NiFi Registry.
• Proficiency in SQL and experience with relational databases (Oracle, SQL Server, PostgreSQL).
• Solid understanding of ETL/ELT concepts and data pipeline design patterns.
• Experience with structured and semi-structured data formats (CSV, JSON, Avro, Parquet).
• Familiarity with Linux environments and basic scripting (Python or Shell).
• Experience using version control systems like Git.

Preferred Skills

• Experience with AWS data services (S3, Glue, Lambda, RDS, Redshift, or EMR).
• Exposure to streaming platforms such as Kafka.
• Experience with containerization tools like Docker or Kubernetes.

Key Skills

Education

Bachelor's degree