Update README.md
Browse files
README.md
CHANGED
@@ -53,14 +53,11 @@ I have quantised the GGML files in this repo with the latest version. Therefore
|
|
53 |
I use the following command line; adjust for your tastes and needs:
|
54 |
|
55 |
```
|
56 |
-
./main -t
|
57 |
-
### Instruction:
|
58 |
-
Write a story about llamas
|
59 |
-
### Response:"
|
60 |
```
|
61 |
-
Change `-t
|
62 |
|
63 |
-
|
64 |
|
65 |
## How to run in `text-generation-webui`
|
66 |
|
|
|
53 |
I use the following command line; adjust for your tastes and needs:
|
54 |
|
55 |
```
|
56 |
+
./main -t 10 -m Gorilla-7B.ggmlv3.q5_0.bin -ngl 32 --color -c 2048 --temp 0.7 --repeat_penalty 1.1 -n -1 -p "###USER: I want to generate image from text.\n###ASSISTANT:"
|
|
|
|
|
|
|
57 |
```
|
58 |
+
Change `-t 10` to the number of physical CPU cores you have. For example if your system has 8 cores/16 threads, use `-t 8`.
|
59 |
|
60 |
+
Remove `-ngl 32` if you do not have GPU acceleration support.
|
61 |
|
62 |
## How to run in `text-generation-webui`
|
63 |
|