Hugging Face's logo

MaziyarPanahi
/
Meta-Llama-3-70B-Instruct-GGUF

Text Generation
GGUF
PyTorch
English
facebook
meta
llama
llama-3
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
conversational
Model card Files Community
26

Upload folder using huggingface_hub

#12
by MaziyarPanahi - opened
base: refs/heads/main
←
from: refs/pr/12
Discussion Files changed
+22
-0
Files changed (7) hide show
  1. .gitattributes +4 -0
  2. Meta-Llama-3-70B-Instruct.IQ1_M.gguf +3 -0
  3. Meta-Llama-3-70B-Instruct.IQ1_S.gguf +3 -0
  4. Meta-Llama-3-70B-Instruct.IQ2_XS.gguf +3 -0
  5. Meta-Llama-3-70B-Instruct.IQ3_XS.gguf +3 -0
  6. Meta-Llama-3-70B-Instruct.IQ4_XS.gguf +3 -0
  7. imatrix.dat +3 -0
.gitattributes CHANGED
@@ -51,3 +51,7 @@ Meta-Llama-3-70B-Instruct.fp16-00001-of-00004.gguf filter=lfs diff=lfs merge=lfs
51
  Meta-Llama-3-70B-Instruct.fp16-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
52
  Meta-Llama-3-70B-Instruct.fp16-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
53
  Meta-Llama-3-70B-Instruct.fp16-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
51
  Meta-Llama-3-70B-Instruct.fp16-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
52
  Meta-Llama-3-70B-Instruct.fp16-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
53
  Meta-Llama-3-70B-Instruct.fp16-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
54
+ Meta-Llama-3-70B-Instruct.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
55
+ Meta-Llama-3-70B-Instruct.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
56
+ Meta-Llama-3-70B-Instruct.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
57
+ imatrix.dat filter=lfs diff=lfs merge=lfs -text
Meta-Llama-3-70B-Instruct.IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cdbe8ac2126a70fa0af3fac7a4fe04f1c76330c50eba8383567587b48b328098
3
+ size 16751708608
Meta-Llama-3-70B-Instruct.IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3797a69f1bdf53fabf9f3a3a8c89730b504dd3209406288515c9944c14093048
3
+ size 15343995328
Meta-Llama-3-70B-Instruct.IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:72dbf29116f12866cf548a48bee4f28cd0535877601b228ce7ce6be36a98bd5f
3
+ size 21142620608
Meta-Llama-3-70B-Instruct.IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c4a67096266cbda35ec09af3e6532692c1e267e6f4e8462fcdcefdef873061ec
3
+ size 29308242368
Meta-Llama-3-70B-Instruct.IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9532768dca814e8fc61ef27d13f82941199233fdfdf90f1fdcf52be92efe00af
3
+ size 37903174080
imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6de601a2a16693f6039e6a3662321305e1002d4bebb41d2fa583d0952355a763
3
+ size 24922254