Minami-su
/

Qwen1.5-0.5B-Chat_llamafy

Text Generation

text-generation-inference

Model card Files Files and versions Community

Minami-su commited on Feb 24

Commit

178a3f0

•

1 Parent(s): f67dba6

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -40,6 +40,7 @@ generate_ids = model.generate(inputs,max_length=2048, streamer=streamer)
 load in 4bit
 hf-causal (pretrained=Qwen1.5-0.5B-Chat), limit: None, provide_description: False, num_fewshot: 0, batch_size: 32
 | Task |Version| Metric |Value | |Stderr|
 |-------------|------:|--------|-----:|---|-----:|
 |arc_challenge| 0|acc |0.2389|± |0.0125|
@@ -51,10 +52,11 @@ hf-causal (pretrained=Qwen1.5-0.5B-Chat), limit: None, provide_description: Fals
 load in 4bit
 hf-causal (pretrained=Qwen1.5-0.5B-Chat_llamafy), limit: None, provide_description: False, num_fewshot: 0, batch_size: 32
 | Task |Version| Metric |Value | |Stderr|
 |-------------|------:|--------|-----:|---|-----:|
 |arc_challenge| 0|acc |0.2398|± |0.0125|
 | | |acc_norm|0.2705|± |0.0130|
 |truthfulqa_mc| 1|mc1 |0.2534|± |0.0152|
 | | |mc2 |0.4322|± |0.0151|
-|winogrande | 0|acc |0.5556|± |0.0140|

 load in 4bit
 hf-causal (pretrained=Qwen1.5-0.5B-Chat), limit: None, provide_description: False, num_fewshot: 0, batch_size: 32
 | Task |Version| Metric |Value | |Stderr|
 |-------------|------:|--------|-----:|---|-----:|
 |arc_challenge| 0|acc |0.2389|± |0.0125|
 load in 4bit
 hf-causal (pretrained=Qwen1.5-0.5B-Chat_llamafy), limit: None, provide_description: False, num_fewshot: 0, batch_size: 32
 | Task |Version| Metric |Value | |Stderr|
 |-------------|------:|--------|-----:|---|-----:|
 |arc_challenge| 0|acc |0.2398|± |0.0125|
 | | |acc_norm|0.2705|± |0.0130|
 |truthfulqa_mc| 1|mc1 |0.2534|± |0.0152|
 | | |mc2 |0.4322|± |0.0151|
+|winogrande | 0|acc |0.5556|± |0.0140|