leafspark
/

DeepSeek-V2-Chat-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

DeepSeek-V2-Chat-GGUF

1 contributor

History: 94 commits

leafspark's picture

readme: fix kv overrides

a1f286f verified 5 months ago

DeepSeek-V2-Chat.bf16.gguf
Upload DeepSeek-V2-Chat.bf16.gguf/DeepSeek-V2-Chat.bf16.part-22-of-22.gguf with huggingface_hub 5 months ago
DeepSeek-V2-Chat.iq2_xxs.gguf
Upload DeepSeek-V2-Chat.iq2_xxs.gguf/DeepSeek-V2-Chat.IQ2_XXS-00003-of-00003.gguf with huggingface_hub 5 months ago
DeepSeek-V2-Chat.iq3_xs.gguf
Upload DeepSeek-V2-Chat.iq3_xs.gguf/DeepSeek-V2-Chat.IQ3_XS-00008-of-00008.gguf with huggingface_hub 5 months ago
DeepSeek-V2-Chat.q2_k.gguf
tool: add kv overrides to start command (win) 5 months ago
DeepSeek-V2-Chat.q3_k_m.gguf
Add readme for q3_k_m 5 months ago
DeepSeek-V2-Chat.q4_k_m.gguf
Upload DeepSeek-V2-Chat.q4_k_m.gguf/DeepSeek-V2-Chat.q4_k_m.split-00006-of-00008.gguf with huggingface_hub 5 months ago
DeepSeek-V2-Chat.q5_k_m.gguf
Create DeepSeek-V2-Chat.q5_k_m.gguf/readme.md 5 months ago
DeepSeek-V2-Chat.q6_k.gguf
Create DeepSeek-V2-Chat.q6_k.gguf/readme.md 5 months ago
DeepSeek-V2-Chat.q8_0.gguf
delete: Use gguf-split instead of Python script 5 months ago
.gitattributes

6.57 kB

Upload DeepSeek-V2-Chat.iq3_xs.gguf/DeepSeek-V2-Chat.IQ3_XS-00008-of-00008.gguf with huggingface_hub 5 months ago
README.md

3.68 kB

readme: fix kv overrides 5 months ago
imatrix.dat

456 MB
LFS

imatrix: add chunk 63 (final) 5 months ago
llama.cpp-039896407afd40e54321d47c5063c46a52da3e01.zip
Pickle imports
- No problematic imports detected
What is a pickle import?
25.4 MB
LFS

build: add precompiled llama.cpp 5 months ago