mudler
/

Mirai-Nova-Llama3-LocalAI-8B-v0.1-GGUF

Inference Endpoints

Model card Files Files and versions Community

Mirai-Nova-Llama3-LocalAI-8B-v0.1-GGUF

1 contributor

History: 3 commits

mudler's picture

Create localai.yaml

17be672 verified 5 months ago

.gitattributes

1.52 kB

initial commit 5 months ago
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q2_k.bin

3.18 GB
LFS

Upload folder using huggingface_hub 5 months ago
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q3_k_l.bin

4.32 GB
LFS

Upload folder using huggingface_hub 5 months ago
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q3_k_m.bin

4.02 GB
LFS

Upload folder using huggingface_hub 5 months ago
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q3_k_s.bin

3.67 GB
LFS

Upload folder using huggingface_hub 5 months ago
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q4_0.bin

4.66 GB
LFS

Upload folder using huggingface_hub 5 months ago
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q4_k_m.bin

4.92 GB
LFS

Upload folder using huggingface_hub 5 months ago
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q4_k_s.bin

4.69 GB
LFS

Upload folder using huggingface_hub 5 months ago
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q5_0.bin

5.6 GB
LFS

Upload folder using huggingface_hub 5 months ago
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q5_k_m.bin

5.73 GB
LFS

Upload folder using huggingface_hub 5 months ago
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q5_k_s.bin

5.6 GB
LFS

Upload folder using huggingface_hub 5 months ago
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q6_k.bin

6.6 GB
LFS

Upload folder using huggingface_hub 5 months ago
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q8_0.bin

8.54 GB
LFS

Upload folder using huggingface_hub 5 months ago
localai.yaml

1.58 kB

Create localai.yaml 5 months ago