Update README.md

README.md

@@ -1,3 +1,27 @@
+# Llama-2-13b SuperCOT lora checkpoints 
+
+These are my Llama-2-13b SuperCOT Loras trained using QLora on the [SuperCOT Dataset](https://huggingface.co/datasets/kaiokendev/SuperCOT-dataset). 
+
+### Architecture
+
+- **Model Architecture**: Llama-2-13b
+- **Training Algorithm**: QLora
+
+### Training Details
+
+- **Dataset**: [SuperCOT Dataset](https://huggingface.co/datasets/kaiokendev/SuperCOT-dataset)
+- **Datset type**: alpaca
+- **Training Parameters**: [See Here](https://github.com/OpenAccess-AI-Collective/axolotl/blob/main/examples/llama-2/qlora.yml)
+- **Training Environment**: Axolotl
+- **sequence_len**: 4096
+
+## Acknowledgments
+
+Special thanks to the creators of the datasets in SuperCOT. Additionally, thanks to Kaiokendev for curating the SuperCOT dataset. Thanks to the contributors of the Axolotl.
+
+
+## Stuff generated from axolotl:
+
 ---
 library_name: peft
 ---