GGUF format
#27
by
abdelrahmanelawady
- opened
ollama is very popular nowdays. they support GGUF. is it possible to provide that format. unfortunately pytorch and tensorflow are not as user friendly and have much more dependencies for training AI models. ollama is inference only and that makes it easier and lighter and more compatible with older machines like mine. pytorch and tensorflow don't work on my machine even in cpu only versions.
please provide GGUF format.