Edit model card

Model Card for Bert2Bert-HunSum-2

The Bert2Bert-HunSum-2 is a Hungarian abstractive summarization model, which was trained on the SZTAKI-HLT/HunSum-2-abstractive dataset. The model is based on SZTAKI-HLT/hubert-base-cc.

Intended uses & limitations

  • Model type: Text Summarization
  • Language(s) (NLP): Hungarian
  • Resource(s) for more information:

Parameters

  • Batch Size: 13
  • Learning Rate: 5e-5
  • Weight Decay: 0.01
  • Warmup Steps: 16000
  • Epochs: 10
  • no_repeat_ngram_size: 3
  • num_beams: 5
  • early_stopping: False

Results

Metric Value
ROUGE-1 40.95
ROUGE-2 14.18
ROUGE-L 27.42
Downloads last month
16
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Dataset used to train SZTAKI-HLT/Bert2Bert-HunSum-2