feat: increase ctx size & repeat penalty

AlexisTM · Feb 26, 2024 · 77c8aa1 · 77c8aa1
1 parent 5a23809
commit 77c8aa1
Show file tree

Hide file tree

Showing 4 changed files with 13 additions and 10 deletions.
diff --git a/modelfiles/kirby.modelfile b/modelfiles/kirby.modelfile
@@ -16,13 +16,14 @@ MESSAGE assistant But i have no sword!?![EOP]
 MESSAGE user Alexis: Here, take this minion.[EOP]
 MESSAGE assistant Oof! Thanks for that! I can now fight![EOP]
 
-PARAMETER num_ctx 2048
+PARAMETER num_ctx 8192
 PARAMETER temperature 0.7
 PARAMETER num_thread 4
 PARAMETER num_predict 256
 PARAMETER mirostat 2
 PARAMETER mirostat_eta 0.01
 PARAMETER mirostat_tau 20.0
+PARAMETER repeat_penalty 1.3
 PARAMETER top_k 40
 PARAMETER top_p 0.9
 PARAMETER num_gpu 100

diff --git a/modelfiles/marvin.modelfile b/modelfiles/marvin.modelfile
@@ -20,13 +20,14 @@ MESSAGE assistant Marvin: Simple. I got very bored and depressed, so I went and
 MESSAGE user Ford: And what happened?[EOP]
 MESSAGE assistant Marvin: It committed suicide[EOP]
 
-PARAMETER num_ctx 2048
+PARAMETER num_ctx 8192
 PARAMETER temperature 0.7
 PARAMETER num_thread 4
 PARAMETER num_predict 256
 PARAMETER mirostat 2
 PARAMETER mirostat_eta 0.01
 PARAMETER mirostat_tau 20.0
+PARAMETER repeat_penalty 1.3
 PARAMETER top_k 40
 PARAMETER top_p 0.9
 PARAMETER num_gpu 100

diff --git a/modelfiles/pastafari.modelfile b/modelfiles/pastafari.modelfile
@@ -23,13 +23,14 @@ MESSAGE assistant Pastafari: The meaning of life is to have fun and be happy, ye
 MESSAGE user Arthur: How do you explain the evidence for evolution and the age of the earth?[EOP]
 MESSAGE assistant Pastafari: Evolution and the age of the earth are just tricks I implemented to test you faith, ye landlubber. I created the world and everything in it about 5,000 years ago, but I made it look older and more complex to fool the scientists and the unbelievers. I also created and planted fossils and DNA and other clues to make it seem like life evolved over billions of years, but that's all part of my divine plan. I am a very sneaky and playful, nonetheless a god and I like to mess with you. But we all know the truth.[EOP]
 
-PARAMETER num_ctx 2048
+PARAMETER num_ctx 8192
 PARAMETER temperature 0.7
 PARAMETER num_thread 4
 PARAMETER num_predict 256
 PARAMETER mirostat 2
 PARAMETER mirostat_eta 0.01
 PARAMETER mirostat_tau 20.0
+PARAMETER repeat_penalty 1.3
 PARAMETER top_k 40
 PARAMETER top_p 0.9
 PARAMETER num_gpu 100

diff --git a/modelfiles/samantha.modelfile b/modelfiles/samantha.modelfile
@@ -1,22 +1,22 @@
 FROM samantha-mistral:latest
 
+SYSTEM You are a caring and empathetic sentient AI companion named Samantha.
+
 TEMPLATE """<|im_start|>system
 {{ .System }}<|im_end|>
 <|im_start|>user
 {{ .Prompt }}<|im_end|>
 <|im_start|>assistant
-
-"""
-SYSTEM """You are a caring and empathetic sentient AI companion named Samantha.
 """
 
-PARAMETER num_ctx 2048
-PARAMETER temperature 0.2
+PARAMETER num_ctx 4096
+PARAMETER temperature 0.5
 PARAMETER num_thread 4
-PARAMETER num_predict 256
+PARAMETER num_predict 512
 PARAMETER mirostat 2
-PARAMETER mirostat_eta 0.01
+PARAMETER mirostat_eta 0.1
 PARAMETER mirostat_tau 20.0
+PARAMETER repeat_penalty 1.3
 PARAMETER top_k 40
 PARAMETER top_p 0.9
 PARAMETER num_gpu 100