Skip to content

Issues: rmihaylov/falcontune

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

32 Open 3 Closed
32 Open 3 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

FalconLite support
#37 opened Aug 17, 2023 by hvico
1
Optimizing Inference Time for Chat Conversations on Falcon
#36 opened Aug 17, 2023 by HumzaSami00
Inference not accurate
#35 opened Jul 18, 2023 by Hamad-exarta
How can I fine-tune with plain sentences instead of pairs of instruction/output or question/answer?
#34 opened Jul 17, 2023 by lucas0
8-bit models
#33 opened Jul 12, 2023 by zepmck
Its working very well but 2 issues:
#32 opened Jul 6, 2023 by TeaCult
Runtime Error : CUDA OUT OF MEMORY
#31 opened Jul 6, 2023 by amnasher
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:1 and cuda:0!
#30 opened Jul 3, 2023 by yufengzhe1
6
Is there any way to load the fine-tuned model to huggingface pipeline?
#29 opened Jun 28, 2023 by lynngao
Does pretrained falcon-40b works on colab?
#28 opened Jun 22, 2023 by imthebilliejoe
RuntimeError: expected scalar type Half but found Char
#27 opened Jun 21, 2023 by cmazzoni87
ValueError: FP16 Mixed precision training with AMP or APEX (--fp16) and FP16 half precision evaluation (--fp16_full_eval) can only be used on CUDA devices
#24 opened Jun 13, 2023 by chintan-donda
1
Metal support
#23 opened Jun 11, 2023 by tmc
RuntimeError: CUDA error: an illegal memory access was encountered
#22 opened Jun 11, 2023 by gpravi
2
ModuleNotFoundError: No module named 'torch._six'
#21 opened Jun 11, 2023 by gpravi
Does fine-tuning support the multi-GPU training?
#20 opened Jun 9, 2023 by cahuja1992
5
OutOfMemoryError: CUDA out of memory. Tried to allocate 256.00 MiB (GPU 0; 79.35 GiB total capacity; 77.18 GiB already allocated; 57.19 MiB free; 77.97 GiB reserved in total by PyTorch)
#19 opened Jun 9, 2023 by gpravi
4
batch_size, seq_length = input_ids.shape ValueError: not enough values to unpack (expected 2, got 1)
#18 opened Jun 8, 2023 by MohamedAliRashad
1
what's the lora target_modules names?
#17 opened Jun 7, 2023 by lucasjinreal
finetune on 4096 context length
#16 opened Jun 6, 2023 by MohamedAliRashad
2
Support multiturn chat ?
#15 opened Jun 5, 2023 by 631068264
Use prompt get error
#14 opened Jun 5, 2023 by 631068264
You are using a model of type RefinedWeb to instantiate a model of type RefinedWebModel. This is not supported for all configurations of models and can yield errors.
#13 opened Jun 5, 2023 by yuhai-china
1
generate get error: RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:1 and cuda:0!
#12 opened Jun 5, 2023 by 631068264
4
RuntimeError: No available kernel. Aborting execution.
#11 opened Jun 2, 2023 by RealCalumPlays
7
ProTip! no:milestone will show everything without a milestone.