From 0680710b06bb886588a48fcf436d2040610d222c Mon Sep 17 00:00:00 2001 From: VJHack Date: Sat, 14 Sep 2024 11:30:10 -0500 Subject: [PATCH] updated README.md for main --- examples/main/README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/examples/main/README.md b/examples/main/README.md index 9396a34fa5a31..8b233fd057374 100644 --- a/examples/main/README.md +++ b/examples/main/README.md @@ -161,6 +161,8 @@ A value of -1 will enable infinite text generation, even though we have a finite If the pause is undesirable, a value of -2 will stop generation immediately when the context is filled. +The `--no-context-shift` options allows you to stop the inifinite text generation once the finite context window is full. + It is important to note that the generated text may be shorter than the specified number of tokens if an End-of-Sequence (EOS) token or a reverse prompt is encountered. In interactive mode, text generation will pause and control will be returned to the user. In non-interactive mode, the program will end. In both cases, the text generation may stop before reaching the specified `--predict` value. If you want the model to keep going without ever producing End-of-Sequence on its own, you can use the `--ignore-eos` parameter. ### Temperature