Text Generation
MLX
mistral

rope_theta in config.json

#3
by akashicmarga - opened
MLX Community org

The quantized model config has rope_theta param, which was throwing an error as it was not used in model args. Removing this parameter worked for generation. @reach-vb how did you quantised the model?

MLX Community org

Sign up or log in to comment