BricksDisplay
/

Yi-6B-Chat-q4

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Yi-6B-Chat-q4 / quantize_config.json

hans00's picture

Upload folder using huggingface_hub

ba8f3a7 verified 7 months ago

111 Bytes

	{
	"per_channel": false,
	"reduce_range": false,
	"quantize_mode": "hqq",
	"per_model_config": {}
	}