Description

You will build and operate serving stores, sync pipelines, and API layers for AI pilot use cases, configuring end-to-end integrations from source binding to consumer delivery.

This role is on-site.

Responsibilities

• Configure pilot end-to-end, including source table binding, key schema, sync schedules, and consumer integration.
• Set up CI/CD pipelines with automated tests for sync correctness, API contract validation, and latency benchmarks.
• Operate data products to defined SLAs for latency, freshness, and availability.
• Partner with domain teams to onboard use cases onto established serving patterns.
• Contribute to reference implementations, blueprints, and documentation for future reuse.

Required Skills

• 5+ years production Python with FastAPI or comparable for versioned REST APIs and contract governance.
• Hands-on experience building and operating end-to-end batch and real-time data pipelines using Kafka or comparable streaming tools.
• Production experience with CDC or incremental batch processing.
• Proficiency with caching and key-value serving systems like Redis or Valkey, including cache invalidation and TTL strategies.
• Experience with vector databases and knowledge graphs (Pinecone, Weaviate, pgvector, Neo4j) for embeddings and retrieval patterns.
• Production Azure Databricks and Delta Lake experience, including Unity Catalog and Delta Lake internals (transaction log, time travel, CDF).
• Strong SQL and data modeling skills, comfortable with point-lookup vs analytical query patterns.
• CI/CD proficiency with GitLab or GitHub Actions, including automated testing for data pipelines.

Preferred Skills

• Experience with embedded analytical engines like DuckDB.
• Production experience with Microsoft Fabric, OneLake, or Power BI Semantic Models.

Referral Bonus: ₹50,000

Key Skills

Education

Any Gradute