phi-2-GPTQ / quantize_config.json
TheBloke's picture
GPTQ model commit
9f9fe8a
raw
history blame
197 Bytes
{
"bits": [
4
],
"group_size": [
128
],
"damp_percent": [
0.1
],
"desc_act": [
true
],
"sym": true,
"true_sequential": true
}