Description

You will design and build ETL pipelines and data ingestion frameworks for high-volume data flows in a on-site environment.

This role is on-site.

Responsibilities

• Build and maintain ETL pipelines using Kafka, NiFi, and AWS services (S3, SQS).
• Develop and optimize data ingestion frameworks in Java or Python.
• Troubleshoot data pipeline failures, system performance bottlenecks, and dataflow issues.
• Containerize deployments using Kubernetes and Docker.
• Maintain strict adherence to DoD 8570 IAT II certification requirements.

Required Skills

• 14+ years of experience in data engineering or software engineering.
• Proficiency in Java and/or Python, including unit and integration testing.
• Strong understanding of data formats: JSON, XML, SQL schemas, and compressed formats.
• Hands-on experience with Kafka and Apache NiFi.
• Experience with AWS S3 and SQS.
• Familiarity with containerization tools (Kubernetes, Docker).
• DoD 8570 IAT II certification (or higher) is mandatory.

Preferred Skills

• Experience in cyber or network operations environments.
• Familiarity with Apache Airflow or Mage AI.

Key Skills

Education

Any Gradute