Description

You will design, build, and maintain data pipelines to support analytical workloads.

Responsibilities

• Design and implement ETL processes, covering data preparation, transformation, and loading from various sources.
• Administer and troubleshoot data flow solutions using Kafka, NiFi, and AWS S3/SQS.
• Decompose complex technical problems and troubleshoot issues across systems and dataflows.
• Conduct data model reviews, covering data meaning, storage, creation, ingest, and processing.
• Develop custom logic for data modification originating from diverse sources.

Required Skills

• Minimum 14 years of experience in software, data, or database engineering.
• Current active TS/SCI security clearance eligibility.
• Expertise in data modeling design, analysis, and troubleshooting from ingest to visualization.
• Significant experience administering and building/troubleshooting data flows in Apache NiFi.
• Proficiency with Java, including unit and integration testing experience.
• Familiarity with SQL schemas and writing statements.
• Experience managing data flow and storage using Kafka, AWS S3, and AWS SQS.
• Proficiency with version control using Maven and GitLab.
• Experience with Linux OS (BASH) and basic server administration.
• Familiarity with data formats including JSON and XML.

Key Skills

Education

Any Gradute