-
Notifications
You must be signed in to change notification settings - Fork 1.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Wrong context_overflow_policy
for LM Studio
#1782
Comments
there is a script called api.py in my anaconda3/envs/myenv/lib/site-packages/memgpt/local_llm/lmstudio/api.py and it has a few lines that say this: This controls how LM studio handles context overflow
i deleted those lines and saved the file and it started working. |
Yeah, I found that but then had some problems getting the Docker environment work in development mode (some config files missing) and haven't had time to play with it further. |
Description
Letta seems to be creating requests for LM studio with
context_overflow_policy
set to0
.Expected values seem to be
'stopAtLimit' | 'truncateMiddle' | 'rollingWindow'
as seen in the error from LM Studio:Setup
The text was updated successfully, but these errors were encountered: