Description

Must-haves:

• S3 — hard requirement, production experience building into S3-backed storage
• Databricks — hard requirement, hands-on
• Senior-level production pipeline build experience — must be able to own the function independently
• EC2 / AWS compute experience
• Apache stack, Kafka, and lakehouse/Icehouse architecture exposure
• Time-series data environment — pipeline capability is the gate, not domain knowledge of the underlying test data
• FAANG background preferred (Meta, Amazon, Apple, Netflix, Alphabet)

Scope:

• Day one: strategy session with Kris and Alex to assess the existing pipeline landscape and set direction before building
• Build pipelines from scratch — primary focus; Box migration is the smaller piece
• First build targets: vibe table data, battery lab data (with Jira integration), and DevTest laptop data (storage → connectivity → analysis)
• ~90% hands-on build, ~10% architecture and standards-setting
• Mostly new capability, not break/fix
• Establish data quality validation, hardened checks, and a formal observability method
• Contribute to pipeline and data integrity protections as AI-driven interaction with the data increases
• Align with central data team on tooling and standards while DevTest owns its own pipelines
• Primary customer is internal DevTest — the lab is the first and largest consumer

Key Skills

Education

Any Graduate