DeepInfra
/

Llama-2-70b-chat-hf-trt-fp8

Model card Files Files and versions Community

Llama-2-70b-chat-hf-trt-fp8 / postprocessing

Commit History

bugfix

e4788f3

yessenzhar commited on Dec 18, 2023

update models for newer trt 0.6.1 version

dd20dba

yessenzhar commited on Dec 18, 2023

try bugfix

151b0f6

yessenzhar commited on Dec 12, 2023

remove hardcoded weights and tokenizer dirs, replace with template

5de4d5c

yessenzhar commited on Dec 12, 2023

remove print

d5c7a29

yessenzhar commited on Dec 8, 2023

add smaller files

a83b588

yessenzhar commited on Dec 7, 2023