Error: json: cannot unmarshal array into Go struct field Params.eos_token_id of type int
#10
by
asdfsadfsdf
- opened
在用ollama的safetensors安装时报错
Error: json: cannot unmarshal array into Go struct field Params.eos_token_id of type int
makefile文件长这样：
FROM "./"
TEMPLATE "{% set loop_messages = messages %}{% for message in loop_messages %}{% set content = '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' %}{% if loop.index0 == 0 %}{% set content = bos_token + content %}{% endif %}{{ content }}{% endfor %}{{ '<|start_header_id|>assistant<|end_header_id|>\n\n' }}"
llama3.1_8b_chinese_chat_q4_k_m.gguf
无感成功部署