chat template?

#1
by aaha - opened

Hi!
What chat template should be used? I saw in the original model that it was randomly generating gibberish making it unusable. Do you think this could be due to a template issue? Given it scores so high i'd like to give this a try, but want to make sure i am using it right. Thanks again for amazing job helping the community with ggufs @MaziyarPanahi !

btw, there is this amazing model with very high MMLU from causalLM CausalLM/34b-beta. Can you share gguf for that? Thanks again!

Hi @aaha
I will look into this model, in the meantime this the GGUF of that 34B model: https://huggingface.co/MaziyarPanahi/34b-beta-GGUF

Thanks @MaziyarPanahi ..Appreciate it!

Any word on the chat template?

Any word on the chat template?

The chat template is alpaca, such as:

Instruction:

{instruction}

Response:

Sign up or log in to comment