Update README.md
Browse files
README.md
CHANGED
|
@@ -38,7 +38,7 @@ Don't worry even if you don't get the results you want.
|
|
| 38 |
|
| 39 |
I'll find the answer for you.
|
| 40 |
|
| 41 |
-
Soon real PoSE to extend Llama's context length to 64k with using my merge method :
|
| 42 |
|
| 43 |
I have found that most of merge's model outside so far do not actually have 64k in their configs. I will improve it in the next merge with my reborn. If that doesn't work, I guess I'll have to find another way, right?
|
| 44 |
|
|
|
|
| 38 |
|
| 39 |
I'll find the answer for you.
|
| 40 |
|
| 41 |
+
Soon real PoSE to extend Llama's context length to 64k with using my merge method : [reborn](https://medium.com/@puffanddmx82/reborn-elevating-model-adaptation-with-merging-for-superior-nlp-performance-f604e8e307b2)
|
| 42 |
|
| 43 |
I have found that most of merge's model outside so far do not actually have 64k in their configs. I will improve it in the next merge with my reborn. If that doesn't work, I guess I'll have to find another way, right?
|
| 44 |
|