Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

More rewind on anti-slop if there are no available continuations #1234

Open
envy-ai opened this issue Nov 22, 2024 · 2 comments
Open

More rewind on anti-slop if there are no available continuations #1234

envy-ai opened this issue Nov 22, 2024 · 2 comments

Comments

@envy-ai
Copy link

envy-ai commented Nov 22, 2024

Here's my ban list

"eyes glint"
"eyes full"
"eyes gleam"
"eyes sparkl"
"eyes twinkl"
"eyes shin"
"eyes glow"
"eye glint"
"eye full"
"eye gleam"
"eye sparkl"
"eye twinkl"
"eye shin"
"eye glow"

At one point, the model got stuck at "her emerald eyes", and apparently couldn't think of anything other than glinting with mischief, but since all of those phrases were banned, it just stopped generating, no matter how many times I retried, turned the temperature up, adjusted the parameters, and so on. It would be nice to be able to configure how far it can walk back until it's able to generate something.

@LostRuins
Copy link
Owner

It'll always rewind to the start of the banned phrase. So you might want to ban "her emerald eyes glint" instead, and it will rewind all the way to "her"

@jojorne
Copy link

jojorne commented Nov 29, 2024

It'll always rewind to the start of the banned phrase.

I didn't know that. I thought it was before "her." 😅

Also, using the dash (-) key creates some funny behavior, as it has several tokens for it (e.g., et-f, ed-th). It's normal and varies from model to model so I don't advise using dash.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants