gemma-2-9b-it-ov-int8 / model.yaml
fakezeta's picture
Upload folder using huggingface_hub
d0d8c4b verified
raw
history blame contribute delete
179 Bytes
name: gemma-2-9b-it
backend: transformers
parameters:
model: fakezeta/gemma-2-9b-it-ov-int8
context_size: 8192
type: OVModelForCausalLM
template:
use_tokenizer_template: true