fakezeta
/

Meta-Llama-3.1-8B-Instruct-ov-int8

Text Generation

Model card Files Files and versions Community

Meta-Llama-3.1-8B-Instruct-ov-int8 / model.yaml

fakezeta's picture

Upload 2 files

2ff20e8 verified 3 months ago

history blame contribute delete

190 Bytes

	name: llama-3.1
	backend: transformers
	parameters:
	model: fakezeta/Meta-Llama-3.1-8B-Instruct-ov-int8
	context_size: 8192
	type: OVModelForCausalLM
	template:
	use_tokenizer_template: true