Deletion or retry does not actually remove the chat message in Chat with AI when Context Agent is used

[kyteinsky]

Which version of assistant are you using?

3.5.0-dev.2

Which version of Nextcloud are you using?

v35.0.0.1

Which browser are you using? In case you are using the phone App, specify the Android or iOS version and device please.

No response

Describe the Bug

The same happens when the last message is regenerated. It is gone from the UI but the chat message remains in the history.

An example where the chat message in the middle was deleted but the agent remembers it verbatim:

Expected Behavior

/

To Reproduce

/

[marcelklehr]

The reason for this is, I believe, that assistant stores one conversation token per chat session, and only the latest one. If you go back one message, there is no conversation token for that state anymore. 💥 So, the solution for this would be to store tokens for all messages, instead of per session, I guess. That would quickly use more storage, though.