include sample code to run the model in readme

README.md

@@ -49,6 +49,36 @@ We evaluate on an extensive set of downstream tasks including reasoning, reading
 | Open-LLaMA-3B-v2 | 1T | 55.7 |
 | Sheared-LLaMA-2.7B | 50B | 56.7 |
 
+## Code Sample using transformers library
+
+```
+from transformers import AutoModelForCausalLM, AutoTokenizer
+
+# Load model and tokenizer
+model = "Sheared-LLaMA-1.3B/" # Replace with the actual path
+tokenizer = AutoTokenizer.from_pretrained(model)
+model = AutoModelForCausalLM.from_pretrained(model)
+
+# Input prompt
+input_text = "Once upon a time"
+input_ids = tokenizer.encode(input_text, return_tensors='pt')
+
+# Generate text
+output = model.generate(
+ input_ids,
+ max_length=100,
+ num_return_sequences=1,
+ no_repeat_ngram_size=2,
+ temperature=0.7,
+ top_p=0.9,
+ do_sample=True
+)
+
+# Decode and print the generated text
+generated_text = tokenizer.decode(output[0], skip_special_tokens=True)
+print(generated_text)
+```
+
 ## Bibtex
 ```
 @article{xia2023sheared,