← Back to jobs

E-Solutions Logo
Senior Data Engineer

E-Solutions

 

Oaks, PA, USA

Posted On: Just posted
Experience: 10+ years
Availability: Onsite
Openings: 1
Category: Senior Data Engineer
Tenure: Contract - Corp-to-Corp
Related Jobs

No related jobs found

Description

Design and maintain production-grade data infrastructure for agentic AI systems, focusing on memory, retrieval, and vector search.

This role is on-site.

Responsibilities

  • Architect data models, storage designs, and query strategies for high-write, low-latency workloads.
  • Implement agent memory systems including session state, short/long-term memory, summarisation, and retention policies.
  • Design and tune vector and semantic search pipelines using Azure AI Search, PostgreSQL with pgvector, or Elasticsearch.
  • Manage caching layers (e.g., Redis) for volatile state and optimise retrieval-augmented generation (RAG) chunking and embedding strategies.
  • Evaluate retrieval quality using groundedness and relevance metrics to drive iterative improvements.

Required Skills

  • 5+ years of hands-on data engineering in production environments.
  • 3+ years working on agentic or LLM data patterns, with deep expertise in agent memory management.
  • 3+ years with vector and semantic search technologies, including hybrid search and index design.
  • 3+ years designing NoSQL, document, or key-value stores for conversational data patterns.
  • 2+ years working with caching or in-memory stores like Redis for ephemeral state.
  • 3+ years of Python development to production standards, building interfaces consumed by other engineers.
  • 2+ years of experience on a major cloud platform, including managed data services and private networking.

Preferred Skills

  • Experience evaluating retrieval and memory quality using groundedness or relevance measures.
  • Knowledge of retrieval-augmented generation trade-offs between model choice, chunking, and cost.

Education

Bachelor's degree

Related Jobs

No related jobs found

← Back to jobs