Some GGUF v2 quantizations of the model AtAndDev/ShortKing-3b-v0.2
Prompt template:
### SYSTEM:
<system_prompt_here>
### HUMAN:
<prompter_message_here>
### INPUT:
<input_text_here>
### RESPONSE:
<leave_a_blank_line_here>
Note: If you dont have a system or input text, do not include the tokens in the prompt.
- Downloads last month
- 48