dolphin-2.9.4-llama-3.1-8b-ov

dolphin-2.9.4-llama-3.1-8b-ov is an OpenVino int4 quantized version of dolphin-2.9.4-llama-3.1-8b-ov, providing a fast inference implementation, optimized for AI PCs using Intel GPU, CPU and NPU.

dolphin-2.9.4-llama-3.1-8b is a leading open source Dolphin fine-tuned model on top of Llama 3.1 base.

Model Description

Developed by: cognitive computations
Quantized by: llmware
Model type: llama-3.1
Parameters: 8 billion
Model Parent: cognitivecomputations/dolphin-2.9.4-llama-3.1-8b
Language(s) (NLP): English
License: Llama 3.1 Community License
Uses: General chat use cases
RAG Benchmark Accuracy Score: NA
Quantization: int4

Model Card Contact

llmware on github

llmware on hf

llmware website