Will you share the code for this space?
#9
by
miandai
- opened
I want to deploy it locally. Sincere thanks.
You can do it with vllm out of the box. Or use any Yi-34B-llama converted model, since this Yi model is exactly llama2 arhictect behind the scene. Yi just outcompte by having a better pretrain dataset and hyperparameters, or some other pretraining techniques
As it seems like your question has been answered, if there is nothing else we can help you with on this matter, we will be closing this discussion for now.
If you have any further questions, feel free to reopen this discussion or start a new one.
Thank you for your contribution to this community!
richardllin
changed discussion status to
closed