-
Notifications
You must be signed in to change notification settings - Fork 13
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Knowledge - actually inject context based on user input #326
Comments
Keeping some notes here:
|
Large changes to how knowledge is integrated: #385 |
Tested with build from We now see While testing this feature , there were couple of instances were I see the queries made relating to the knowledge file are not being answered from the knowledge file. In these cases , output from knowledgeInstruction is empyt ( Detailed steps to reproduce the issue is tracked in the following 2 issues: |
From a convo with Thorsten:
Right now, it is pretty naive: we have a static context that says something dumb like "you have an ad hoc rag tool..." and then we rely on the LLM deciding to call retreival
I think it's time to do a proper "Retrieval Augmented Generation" wherein we write a context tool that looks at the input from the user, figures out if knowledge has relevant information about that input, and if it does, go ahead and add it as context.
My success criteria is:
The text was updated successfully, but these errors were encountered: