Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add custom default Retriever/TextSplitter, update deprecated OpenAI model #67

Merged
merged 17 commits into from
Sep 2, 2024

Conversation

stefanorosanelli
Copy link
Contributor

@stefanorosanelli stefanorosanelli commented Aug 29, 2024

This PR updates and improves general Brevia settings:

  • gpt-4o-mini is now used as defatul OpenAI model instead of the deprecated gpt-3.5-turbo*
  • a new general setting text_splitter variable to activate a custom default TextSplitter via a JSON configuration => enabled using a newTEXT_SPLITTER env variabile
  • a new general setting qa_retriever variable to activate a custom default Retriever via a JSON configuration to be used in /chat endpoing => enabled using a new QA_RETRIVER env variabile
  • (fix) chunk_size and chunk_overlap in a collection metadata config are now correctly handled:
    • if present they override general settings
    • same params specified in text_splitter conf will in turn override the previous ones

@stefanorosanelli stefanorosanelli changed the title Feat/base settings update Add custom default Retriever/TextSplitter, update deprecated OpenAI model Aug 30, 2024
@stefanorosanelli stefanorosanelli marked this pull request as ready for review August 30, 2024 14:25
@nikazzio nikazzio merged commit 2635cf1 into brevia-ai:main Sep 2, 2024
10 checks passed
@nikazzio nikazzio deleted the feat/base-settings-update branch September 2, 2024 08:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants