Can you share code/resources for Self Knowledge learning?

[ucalyptus2]

[ucalyptus2]

cc: @jon-tow @hardmaru @estability

[ucalyptus2]

Mirror: https://huggingface.co/stabilityai/stablelm-2-12b-chat/discussions/3

[maxim-saplin]

I am curious about that part very much - tinkering with StableLM and trying to find a way to teach the assistant its' own name.

P.S.> a dirty hack that worked for me was running LORA for 3 epoch with just 16 records in the dataset (on top of SFT instruction tuned base model) that had the prompts with different versions of "what is your name" conversation. It worked yet did hit the overall quality of responses.