Description

You will lead the architecture, design, and implementation of scalable, modular data flow pipelines for security telemetry.

This role is on-site.

Responsibilities

• Design and implement ingestion frameworks supporting sources like Kafka, Syslog, HTTP, Event Hubs, and Blob Storage.
• Deliver data to destinations including Snowflake, Splunk, ADX, and Log Analytics.
• Spearhead the adoption of a schema normalization strategy using OCSF, including field mapping and validation.
• Implement custom data transformations and enrichments using Python or Groovy.
• Ensure end-to-end data traceability and lineage across the ingestion, transformation, and storage lifecycle.

Required Skills

• 5+ years of experience in data engineering.
• Hands-on experience with Snowflake and Splunk data platforms.
• Proficiency with ingestion sources: Kafka, Syslog, HTTP, Event Hubs, and Blob Storage.
• Strong scripting skills in Python, Groovy, or JavaScript for data transformation.
• Experience implementing data governance, including SSL/TLS and input validation.
• Ability to implement transformations such as filtering, enrichment, and dynamic routing.
• Familiarity with the Open Cybersecurity Schema Framework (OCSF).

Preferred Skills

• Experience with Azure Data Explorer (ADX) and Log Analytics.
• Background in security telemetry data management.

Key Skills

Education

Any Gradute