Saturday, May 9, 2026

Challenges in conversational memory

 Conversational memory in itself can be a RAG.  There are huge challenges in conversational memory: 


ComplexityWhy it is a complexity
memory retrievalanother retrieval system
memory rankingrelevance conflicts
memory embeddingsextra vector store
persistencestorage layer 
stale memoriesoutdated info
contradiction handlingconflicting memory
memory contaminationbad past answers reused

No comments:

Post a Comment

Comparing Semantic Search and Keyword Search

There are certain use cases where semantic search excels , at others keyword search excels. Hence the modern production systems use hybri...