Description

Key Responsibilities

• Design, develop, and maintain event-driven data systems supporting high-volume transactional workloads.
• Build and manage streaming pipelines with appropriate partitioning, ordering, consumer semantics, replay, and delivery guarantees.
• Design relational read models and projections using strong SQL and transactional data-modeling principles.
• Develop reliable integrations between streaming platforms and cloud object storage for historical and archival data.
• Implement data pipelines with idempotency, exactly-once processing where required, schema management, and reliable replay capabilities.
• Design secure multi-tenant data architectures with appropriate row-level and request-level isolation.
• Implement and maintain security controls for relational databases, event streams, and object storage, including encryption at rest and in transit.
• Design object-storage architectures involving bucket/prefix organization, partitioning, schema evolution, lifecycle management, immutability, and tiering.
• Determine what data should remain hot, be projected into relational stores, cached, or archived into object/lakehouse storage.
• Develop automated unit and integration tests validating event ordering, replay, projection correctness, idempotency, and cross-tenant isolation.
• Use service mocking, test-data generation, and local cloud emulation to validate distributed systems before deployment.
• Leverage modern AI-assisted development tools while rigorously reviewing and verifying AI-generated code and tests.
• Identify security, data-exposure, access-control, and correctness issues in generated or contributed code.
• Work within established architectural standards while maintaining system consistency and delivery quality.
• Take ownership of assigned development work from design through implementation, testing, and production readiness.
• Communicate technical risks, progress, dependencies, and delivery status clearly.

Required Qualifications

• 6+ years of recent, hands-on software/data engineering experience with significant personally built and delivered systems.
• Strong experience with streaming and event-processing platforms, including partitioning, ordering, consumer semantics, replay, and delivery guarantees.
• Strong SQL and relational database experience with transactional/OLTP data modeling.
• Demonstrated experience designing read models, projections, and data-access patterns.
• Hands-on experience with cloud object storage and lakehouse technologies.
• Experience integrating streaming/event platforms with object storage for archival and historical data.
• Strong understanding of data security, including tenant/row-level isolation, encryption, access controls, and secure object-storage configuration.
• Strong Python development skills.
• Experience with serverless/cloud-native development, with object storage and serverless compute serving as primary building blocks.
• Container development experience, including containerized local development and packaging of compute workloads.
• Experience with local cloud emulation for development and testing.
• Strong automated testing experience across unit and integration testing.
• Ability to validate complex data properties such as replay, idempotency, projection-versus-log correctness, and cross-tenant isolation.
• Experience using modern AI-assisted software development tools and the ability to verify AI-generated code and tests rather than accepting output at face value.
• Strong communication skills and demonstrated ownership of technical deliverables.

Preferred Qualifications

• Experience with cloud data services and data-platform technologies.
• Experience with key management, secrets management, and securing data stores.
• Experience with data retention, records lifecycle, immutability, and archival strategies.
• Container orchestration experience.
• Experience handling high-volume IoT, telemetry, or event-driven data.
• Experience with observability and distributed-tracing technologies.
• Experience working in a data-intensive, operationally complex environment

Key Skills

Education

Bachelor's degree