bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-4.3bpw-6hb-exl2 Text Generation • Updated 6 days ago • 112 • 3
bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-8.0bpw-8hb-exl2 Text Generation • Updated 7 days ago • 111 • 2
neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8 Text Generation • Updated 12 days ago • 26.1k • 7
neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16 Text Generation • Updated 12 days ago • 148k • 21
ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16 Text Generation • Updated Sep 17 • 902 • 43
bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-7.0bpw-8hb-exl2 Text Generation • Updated 7 days ago • 23 • 1
neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a16 Text Generation • Updated 13 days ago • 944 • 1