Talk to Doc without chat history? #7860
Unanswered
MartinMayoIglesias
asked this question in
Questions
Replies: 1 comment
-
We are working on memory abstractions and better examples for this use case. Coming soon... |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I noticed that in haystack 2.0 there is a new version for the "talk to document" tutorial. Now it uses function callings to look for the information in the documents, but as it is coded the chat history is not part of the prompt used in the RAG function, i.e. the chat history it is never used when gpt decides to reply using the documents, instead it is only used internally by openai to decide whether the tool should be used or not.
On the other hand in haystack 1.0 the "talk to document" tutorial does uses the chat history (as a "memory" object, type ConversationSummaryMemory) as part of the prompt together with the documents.
Was there any reason to remove the "memory" (chat history) in the pure RAG prompt??
Beta Was this translation helpful? Give feedback.
All reactions