-
Notifications
You must be signed in to change notification settings - Fork 1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Issue with Dolly Dataloader: context
key not found!
#1760
Comments
@rasbt Maybe you can take a look if you have some time. I think the original implementation was done by you (if I am not mistaken). |
Thanks for the note. Not sure what happened there. Maybe I forgot to adjust the dataset as we updated the data loader. I will try to take a look next week. (In the meantime, if you got it to work, I'd appreciate a PR) |
@rasbt I will fix it within one to two days and create a PR. |
@rasbt could you assign this issue to me before I begin? |
Of course, happy to assign you (I just see that @Andrei-Aksionov already beat me to it though 😅) |
Bug description
I ran into the following issue while running LoRA fine-tuning.
Stack Trace
Command
I spent some time debugging it. It seems like
_transform
method is being called twice at the beginning for some reason. During the second call, they keys are not there since we are usingpop
. It does work withget
though.In
src/litgpt/litgpt/data/dolly.py
(commented parts are for debugging):I couldn't figure out why it is being called twice though.
What operating system are you using?
macOS
LitGPT Version
Tested on two versions. Also tested on two platforms
macOS
andlinux
.The text was updated successfully, but these errors were encountered: