llama3-8B-Instruct mmlu-5shot: What is the test method to get the accuracy of 68.4？
#181
by
wwwdas
- opened
llama3-8B-Instruct mmlu-5shot: What is the test method to get the accuracy of 68.4？
I can't get an accuracy of 68.4 or close to it using opencompass，just66.64.
The model configuration file I used in opencompass is opencompass_suinfer-llm/configs/models/hf_llama/hf_llama3_8b_instruct.py, and the dataset configuration file is mmlu_gen_5d1409.