GGUF版推迟发布公告(已恢复下载) #9
Closed
ymcui
announced in
Announcements
Replies: 2 comments
|
Instruct版已修复完毕,HF版已上传,modelscope稍后同步。以下是前后PPL对比:
|
0 replies
|
Base版已修复完毕,HF版已上传,modelscope稍后同步。以下是前后PPL对比:
|
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
llama.cpp在几小时前对Llama-3 pre-tokenizer做出了重大改动(这个PR:ggml-org/llama.cpp#6920 )。
导致模型需要重新转换,现已将GGUF版模型下架。(模型已恢复下载)1)用户可根据需要,手动转换HF版模型到GGUF
2)晚些时候更新GGUF版模型
如llama.cpp加载模型后,log输出以下内容则说明模型需要重新转换:
All reactions