Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Model Tree
Reset
meta-llama/Llama-3.1-70B
Adapters
Finetunes
Quantizations
Merges
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
Inference Endpoints
AutoTrain Compatible
text-generation-inference
Eval Results
4-bit precision
Merge
custom_code
text-embeddings-inference
8-bit precision
Carbon Emissions
Mixture of Experts
Apply filters
Models
29
Full-text search
Edit filters
Sort: Trending
Active filters:
meta-llama/Llama-3.1-70B
Clear all
hugging-quants/Meta-Llama-3.1-70B-BNB-NF4-BF16
Text Generation
•
Updated
Aug 8
•
672
•
2
mradermacher/Meta-Llama-3.1-70B-GGUF
Updated
Aug 2
•
482
mradermacher/Meta-Llama-3.1-70B-i1-GGUF
Updated
Aug 2
•
1.15k
•
1
neuralmagic/Meta-Llama-3.1-70B-FP8
Text Generation
•
Updated
13 days ago
•
539
NousResearch/Hermes-3-Llama-3.1-70B-GGUF
Updated
Aug 23
•
2.08k
•
32
LoneStriker/Hermes-3-Llama-3.1-70B-2.4bpw-h6-exl2
Updated
Aug 15
•
1
LoneStriker/Hermes-3-Llama-3.1-70B-3.5bpw-h6-exl2
Updated
Aug 16
•
13
LoneStriker/Hermes-3-Llama-3.1-70B-4.0bpw-h6-exl2
Updated
Aug 16
•
7
LoneStriker/Hermes-3-Llama-3.1-70B-4.65bpw-h6-exl2
Updated
Aug 16
•
14
LoneStriker/Hermes-3-Llama-3.1-70B-5.0bpw-h6-exl2
Updated
Aug 16
•
6
LoneStriker/Hermes-3-Llama-3.1-70B-6.0bpw-h6-exl2
Updated
Aug 16
•
6
LoneStriker/Hermes-3-Llama-3.1-70B-2.25bpw-h6-exl2
Updated
Aug 16
LoneStriker/Hermes-3-Llama-3.1-70B-GGUF
Updated
Aug 16
•
121
•
2
XelotX/Hermes-3-Llama-3.1-70B-GGUF
Updated
Aug 17
•
77
Orion-zhen/Hermes-3-Llama-3.1-70B-4.5bpw-exl2
Updated
Aug 18
•
7
bigstorm/Hermes-3-Llama-3.1-70B-6.5bpw-8hb-exl2
Updated
Aug 22
•
5
bullerwins/Hermes-3-Llama-3.1-70B-exl2_4.0bpw
Updated
Aug 24
•
2
bullerwins/Hermes-3-Llama-3.1-70B-exl2_5.0bpw
Updated
Aug 24
•
1
bullerwins/Hermes-3-Llama-3.1-70B-exl2_6.0bpw
Updated
Aug 24
•
7
Niansuh/Hermes-3-Llama-3.1-70B-GGUF
Updated
Aug 25
•
68
bigstorm/Hermes-3-Llama-3.1-70B-7.0bpw-8hb-exl2
Updated
Aug 26
•
2
bigstorm/Hermes-3-Llama-3.1-70B-8.0bpw-8hb-exl2
Updated
Aug 26
•
8
ArtyLLaMa/LLaMa3.1-Instruct-70b-GGUF
Text Generation
•
Updated
Aug 29
•
133
•
1
unsloth/Hermes-3-Llama-3.1-70B-bnb-4bit
Text Generation
•
Updated
Sep 4
•
219
Ffftdtd5dtft/Meta-Llama-3.1-70B-Q2_K-GGUF
Text Generation
•
Updated
Sep 3
•
126
FriendliAI/Meta-Llama-3.1-70B-Instruct-int8
Text Generation
•
Updated
Sep 9
•
53
ISTA-DASLab/Meta-Llama-3.1-70B-AQLM-PV-2Bit-1x16
Text Generation
•
Updated
Sep 14
•
231
•
16
mav23/Llama-3.1-70B-Instruct-GGUF
Text Generation
•
Updated
19 days ago
•
480
medmekk/Llama-3.1-70B-torchao-int8_weight_only
Updated
14 days ago
•
43