Convertion to HF
#7
by
lbathen
- opened
Is there a way to convert this model to HF? I realize that NeMo has a few converters but the ones in the repo are only for base hf models, not for reward models. Thank you!
We have a PR on going to convert Nemotron 340B to HF https://github.com/huggingface/transformers/pull/31699 and once that's merged, we will show how it can be used to run this reward model (using the same class) in addition to base/instruct models