lewtun HF staff autoevaluator HF staff commited on
Commit
254548d
1 Parent(s): 36985dd

Add evaluation results on scientific_papers dataset (#1)

Browse files

- Add evaluation results on scientific_papers dataset (b85c159175f7b4d266491073deb57dbb4de0b5aa)
- Merge branch 'main' into pr/1 (2f44a4dcc56a60ecbbb9d0348a3f84738b520f7f)


Co-authored-by: Evaluation Bot <[email protected]>

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -111,6 +111,39 @@ model-index:
111
  type: gen_len
112
  value: 230.4886
113
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
114
  ---
115
 
116
  # BigBirdPegasus model (large)
 
111
  type: gen_len
112
  value: 230.4886
113
  verified: true
114
+ - task:
115
+ type: summarization
116
+ name: Summarization
117
+ dataset:
118
+ name: scientific_papers
119
+ type: scientific_papers
120
+ config: arxiv
121
+ split: test
122
+ metrics:
123
+ - name: ROUGE-1
124
+ type: rouge
125
+ value: 43.4702
126
+ verified: true
127
+ - name: ROUGE-2
128
+ type: rouge
129
+ value: 17.4297
130
+ verified: true
131
+ - name: ROUGE-L
132
+ type: rouge
133
+ value: 26.2587
134
+ verified: true
135
+ - name: ROUGE-LSUM
136
+ type: rouge
137
+ value: 35.5587
138
+ verified: true
139
+ - name: loss
140
+ type: loss
141
+ value: 2.1113228797912598
142
+ verified: true
143
+ - name: gen_len
144
+ type: gen_len
145
+ value: 183.3702
146
+ verified: true
147
  ---
148
 
149
  # BigBirdPegasus model (large)