Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

an issue for repeat a command #3542

Open
Noblezhong opened this issue Sep 30, 2024 · 0 comments
Open

an issue for repeat a command #3542

Noblezhong opened this issue Sep 30, 2024 · 0 comments

Comments

@Noblezhong
Copy link

root@c68c31f45482:/workspace/zt/code/FastChat# python3 -m fastchat.model.apply_delta --base-model-path ../../model/Llama-2-7b-hf --target-model-path ../Sequence-Scheduling/ckpts/vicuna-7b --delta-path lmsys/vicuna-7b-delta-v1.1

Loading the delta weights from lmsys/vicuna-7b-delta-v1.1

You are using the default legacy behaviour of the <class 'transformers.models.llama.tokenization_llama.LlamaTokenizer'>. This is expected, and simply means that the legacy (previous) behavior will be used so nothing changes for you. If you want to use the new behaviour, set legacy=False. This should only be set if you understand what it means, and thoroughly read the reason why this was added as explained in huggingface/transformers#24565 - if you loaded a llama tokenizer from a GGUF file you can ignore this message

Downloading shards: 0%| | 0/2 [00:00<?, ?it/s]

I just want to add Vicuna weights to original llama model. The first time i excute the command described in tutorial is normal. But I find i set a wrong output path. So i just cancel this command and run it again. Unfortunately it shows this description, and i have waited more than 30 mins to this download process. So what's wrong with this bug, and how can i fix it. (I have VPN so it's not the network conncetion issue)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant