You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Many thanks for releasing a Python binding for Llama2-cpp!
There is a seed variable in the code that can be set up for Llama2 model. We noticed that the default value is -1 and the official comment said that If -1, a random seed is used..
To disable using a random seed, we are wondering if it just needs to be set up as 0? Whether this (seed=0) will make sure that the model's output will be exactly the same for the same input and the same prompt?
This discussion was converted from issue #632 on September 02, 2023 11:33.
Heading
Bold
Italic
Quote
Code
Link
Numbered list
Unordered list
Task list
Attach files
Mention
Reference
Menu
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hi,
Many thanks for releasing a Python binding for Llama2-cpp!
There is a
seed
variable in the code that can be set up for Llama2 model. We noticed that the default value is-1
and the official comment said thatIf -1, a random seed is used.
.To disable using a random seed, we are wondering if it just needs to be set up as
0
? Whether this (seed=0) will make sure that the model's output will be exactly the same for the same input and the same prompt?Thank you!
Beta Was this translation helpful? Give feedback.
All reactions