Hugging Face's logo

ModelCloud
/
Meta-Llama-3.1-8B-Instruct-gptq-4bit

Text Generation
Transformers
Safetensors
llama
gptq
4bit
int4
gptqmodel
modelcloud
llama-3.1
8b
instruct
conversational
text-generation-inference
Inference Endpoints
4-bit precision
Model card Files Community
7
Meta-Llama-3.1-8B-Instruct-gptq-4bit / quantize_config.json

Commit History

f59dc32f0cab2a02d393cbf38e42b4b8de4d136a8d027ec385931f1cb0a8821f
f1f5cbf
verified

lrl-modelcloud commited on

Upload folder using huggingface_hub (#1)
6bbe42e
verified

lrl-modelcloud commited on