Gracoy commited on
Commit
343c1fc
1 Parent(s): 6d45b80

Upload model

Browse files
Files changed (3) hide show
  1. README.md +5 -5
  2. config.json +1 -1
  3. tf_model.h5 +1 -1
README.md CHANGED
@@ -15,8 +15,8 @@ probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Train Loss: 1.0788
19
- - Validation Loss: 1.0687
20
  - Epoch: 2
21
 
22
  ## Model description
@@ -43,9 +43,9 @@ The following hyperparameters were used during training:
43
 
44
  | Train Loss | Validation Loss | Epoch |
45
  |:----------:|:---------------:|:-----:|
46
- | 1.4717 | 1.1456 | 0 |
47
- | 1.1271 | 1.0922 | 1 |
48
- | 1.0788 | 1.0687 | 2 |
49
 
50
 
51
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Train Loss: 6.1346
19
+ - Validation Loss: 5.9637
20
  - Epoch: 2
21
 
22
  ## Model description
 
43
 
44
  | Train Loss | Validation Loss | Epoch |
45
  |:----------:|:---------------:|:-----:|
46
+ | 6.7263 | 6.7337 | 0 |
47
+ | 6.6426 | 6.2494 | 1 |
48
+ | 6.1346 | 5.9637 | 2 |
49
 
50
 
51
  ### Framework versions
config.json CHANGED
@@ -11,7 +11,7 @@
11
  "initializer_range": 0.02,
12
  "layer_norm_epsilon": 1e-05,
13
  "model_type": "gpt2",
14
- "n_ctx": 1024,
15
  "n_embd": 768,
16
  "n_head": 12,
17
  "n_inner": null,
 
11
  "initializer_range": 0.02,
12
  "layer_norm_epsilon": 1e-05,
13
  "model_type": "gpt2",
14
+ "n_ctx": 256,
15
  "n_embd": 768,
16
  "n_head": 12,
17
  "n_inner": null,
tf_model.h5 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4b1e1814853540841f4e8617dd4824b6d0914723c7fbcef8aa79a360c666a5b5
3
  size 370269264
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a250943b5ecf26bf4f16b352d6c79ac23b16ae3991bbb7e57f7d7997c6adefa5
3
  size 370269264