Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The model has been talking nonsense all along #10

Open
Deng-Xian-Sheng opened this issue Dec 1, 2023 · 2 comments
Open

The model has been talking nonsense all along #10

Deng-Xian-Sheng opened this issue Dec 1, 2023 · 2 comments

Comments

@Deng-Xian-Sheng
Copy link

No description provided.

@ridgerchu
Copy link
Owner

Hi, Sorry for hear that, SpikeGPT is primarily an experimental product and has not undergone processes like Supervised Fine-Tuning (SFT) and Reinforcement Learning from Human Feedback (RLHF). These processes are essential for ensuring more natural and coherent conversations. Without them, SpikeGPT's ability to engage in natural chat is limited...

@fuxuelinwudi
Copy link

this model can't learn how to talk. it's decoding ability is like a shit. it's also what i want to say to rwkv.
this ark don't have a enough result for few-shot task, it needs lots of dataset to fit, so that it will get some good performance.
fucking rwkv, it don't either have half of performance of transformer, even than rnn!!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants