DeepInfra
/

Llama-2-70b-chat-hf-trt-fp8

Model card Files Files and versions Community

Llama-2-70b-chat-hf-trt-fp8 / tensorrt_llm

Commit History

update models for newer trt 0.6.1 version

dd20dba

yessenzhar commited on Dec 18, 2023

add weights compiled by 0.6.1 trtllm

2d64b65

yessenzhar commited on Dec 15, 2023

Revert

03200fe

Pernekhan commited on Dec 13, 2023

Try fixing exclude_input_in_output value field

6005d8a

Pernekhan commited on Dec 13, 2023

exclude input in ouput

891ad10

yessenzhar commited on Dec 13, 2023

remove hardcoded weights and tokenizer dirs, replace with template

5de4d5c

yessenzhar commited on Dec 12, 2023

add trtllm weights

0e96839

yessenzhar commited on Dec 7, 2023

add model cache

2354c48

yessenzhar commited on Dec 7, 2023

add smaller files

a83b588

yessenzhar commited on Dec 7, 2023