Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

64 manager add same trigger restrictions based on blocks 1159 #67

Merged

Conversation

RawthiL
Copy link
Collaborator

@RawthiL RawthiL commented Jun 17, 2024

Two issues solved in this PR ( #41 and #64 ) .
Also this PR includes many minor fixes to complete a successful generation of scores from an empty DB:

  • Added support for signatures evaluation/tracking and added to tokenizers collection.
  • Changed how the sidecard provides data (now are proper JSONs) and unified the code with LMEH functions used for tokenizer loading.
  • Updated the protocol.py classes adding results and tokenizers database entries.
  • Added two collections to hold buffers: buffer_numerical and buffers_signatures. These were removed from nodes collection.
  • Added deletion of entries in tasks, instances, results, responses and prompts collections after a successful processing from the Manager.
  • Added configuration override to allow a number of tasks to trigger even if the number of samples in the buffer is filled (required by the signatures:tokenizer tasks).
  • Fixed some issues with circular buffer calculation.
  • Updated the numerical task response format in the Evaluator.

- signatures working
- tests working, ready to rebase incoming from main
@RawthiL RawthiL linked an issue Jun 17, 2024 that may be closed by this pull request
@RawthiL RawthiL merged commit 31d5687 into main Jun 17, 2024
3 checks passed
@RawthiL RawthiL deleted the 64-manager-add-same-trigger-restrictions-based-on-blocks-1159 branch June 17, 2024 22:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Manager: Add same trigger restrictions based on blocks
2 participants