GGUF
English
Inference Endpoints
Edit model card

Some GGUF v2 quantizations of the model AtAndDev/ShortKing-3b-v0.2

Prompt template:

### SYSTEM:
<system_prompt_here>

### HUMAN:
<prompter_message_here>

### INPUT:
<input_text_here>

### RESPONSE:
<leave_a_blank_line_here>

Note: If you dont have a system or input text, do not include the tokens in the prompt.

Downloads last month
48
GGUF
Model size
3.43B params
Architecture
llama

4-bit

5-bit

Inference API
Unable to determine this model's library. Check the docs .