Description

You will design and implement scalable data pipelines for complex telemetry environments.

This role is on-site.

Responsibilities

• Lead architecture of modular data flow pipelines for multi-source telemetry.
• Design platform-agnostic ingestion frameworks and template-driven architectures.
• Implement schema normalization using Open Cybersecurity Schema Framework (OCSF).
• Develop custom data transformations, filtering, and dynamic routing using scripting.
• Ensure end-to-end data traceability, lineage, and health monitoring integration.

Required Skills

• 10+ years of experience in data engineering or related roles.
• Proficiency in Python, Groovy, or JavaScript for data transformation logic.
• Experience managing data ingestion from Kafka, HTTP, Event Hubs, and Blob Storage.
• Hands-on experience with Snowflake, Splunk, and ADX.
• Ability to implement transformations for JSON, CSV, XML, and Logfmt.
• Strong understanding of data governance, security controls (SSL/TLS), and schema validation.
• Experience managing structured and unstructured security telemetry data at scale.

Key Skills

Education

Any Graduate