Memories

[ceicke]

I saw that my HostedGPT instance created one memory. It's a nice memory that it created, but I was wondering how this works? I saw that ChatGPT has the same thing. When are memories created? How are they used in the prompts?

[krschacht]

To be honest, I haven’t found it to be super useful in practice. But basically the LLM is given an optional function to call if the user just told it something which is the kind of thing they would expect their assistant to remember about them. Then all memories are appended as part of the system prompt here: https://github.com/AllYourBot/hostedgpt/blob/main/app/services/ai_backend.rb#L94

It’s a naive implementation that wouldn’t scale if it started to remember too many things. It also doesn’t account for naturally forgetting information.

I’ve found it a little useful in voice mode. I told it my wife’s name, my wife’s email address, so now I can simply make reference to her by name and it knows who I’m talking about. So it works well to teach it basic facts about yourself.