Upload model
Browse files- README.md +5 -5
- config.json +1 -1
- tf_model.h5 +1 -1
README.md
CHANGED
@@ -15,8 +15,8 @@ probably proofread and complete it, then remove this comment. -->
|
|
15 |
|
16 |
This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.
|
17 |
It achieves the following results on the evaluation set:
|
18 |
-
- Train Loss:
|
19 |
-
- Validation Loss:
|
20 |
- Epoch: 2
|
21 |
|
22 |
## Model description
|
@@ -43,9 +43,9 @@ The following hyperparameters were used during training:
|
|
43 |
|
44 |
| Train Loss | Validation Loss | Epoch |
|
45 |
|:----------:|:---------------:|:-----:|
|
46 |
-
|
|
47 |
-
|
|
48 |
-
|
|
49 |
|
50 |
|
51 |
### Framework versions
|
|
|
15 |
|
16 |
This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.
|
17 |
It achieves the following results on the evaluation set:
|
18 |
+
- Train Loss: 6.1346
|
19 |
+
- Validation Loss: 5.9637
|
20 |
- Epoch: 2
|
21 |
|
22 |
## Model description
|
|
|
43 |
|
44 |
| Train Loss | Validation Loss | Epoch |
|
45 |
|:----------:|:---------------:|:-----:|
|
46 |
+
| 6.7263 | 6.7337 | 0 |
|
47 |
+
| 6.6426 | 6.2494 | 1 |
|
48 |
+
| 6.1346 | 5.9637 | 2 |
|
49 |
|
50 |
|
51 |
### Framework versions
|
config.json
CHANGED
@@ -11,7 +11,7 @@
|
|
11 |
"initializer_range": 0.02,
|
12 |
"layer_norm_epsilon": 1e-05,
|
13 |
"model_type": "gpt2",
|
14 |
-
"n_ctx":
|
15 |
"n_embd": 768,
|
16 |
"n_head": 12,
|
17 |
"n_inner": null,
|
|
|
11 |
"initializer_range": 0.02,
|
12 |
"layer_norm_epsilon": 1e-05,
|
13 |
"model_type": "gpt2",
|
14 |
+
"n_ctx": 256,
|
15 |
"n_embd": 768,
|
16 |
"n_head": 12,
|
17 |
"n_inner": null,
|
tf_model.h5
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 370269264
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a250943b5ecf26bf4f16b352d6c79ac23b16ae3991bbb7e57f7d7997c6adefa5
|
3 |
size 370269264
|