mhenrichsen commited on
Commit
d4c79c0
1 Parent(s): 4b3db6c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -20
README.md CHANGED
@@ -87,26 +87,8 @@ print("AI:", chat_response)
87
  ```
88
 
89
 
90
- ## Training procedure
91
-
92
- ### Training hyperparameters
93
-
94
- The following hyperparameters were used during training:
95
- - learning_rate: 5e-05
96
- - train_batch_size: 16
97
- - eval_batch_size: 16
98
- - seed: 42
99
- - distributed_type: multi-GPU
100
- - num_devices: 4
101
- - gradient_accumulation_steps: 4
102
- - total_train_batch_size: 256
103
- - total_eval_batch_size: 64
104
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
105
- - lr_scheduler_type: cosine
106
- - lr_scheduler_warmup_steps: 10
107
- - num_epochs: 3
108
-
109
- ### Training results
110
 
111
  | Training Loss | Epoch | Step | Validation Loss |
112
  |:-------------:|:-----:|:----:|:---------------:|
 
87
  ```
88
 
89
 
90
+ ## Training results
91
+
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
92
 
93
  | Training Loss | Epoch | Step | Validation Loss |
94
  |:-------------:|:-----:|:----:|:---------------:|