zhengr

/

MixTAO-7Bx2-MoE-v8.1-GGUF

like 8

would you please re-convert the GGUF using a newer version (newer than 2024-04apr-03) of llama.cpp for better performance?

see
https://github.com/ggerganov/llama.cpp/#hot-topics
MoE memory layout has been updated - reconvert models for mmap support and regenerate imatrix

https://github.com/ggerganov/llama.cpp/pull/6387

thx