-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Bloom, H3 post #91
base: v4
Are you sure you want to change the base?
Bloom, H3 post #91
Conversation
Deploying blog with
|
Latest commit: |
3c92c23
|
Status: | ✅ Deploy successful! |
Preview URL: | https://6f0820a8.plastic-labs-github-io.pages.dev |
Branch Preview URL: | https://bloom-h3.plastic-labs-github-io.pages.dev |
![[who are you.png]] | ||
*Image generated by creating a chatroom on OpenRouter* | ||
|
||
However, time and time again it's been demonstrated that the most interesting AI identities are the ones we *can't* predict. They're ones that are obsessed with obscure 90's internet shock memes, proselytize that meme's singularity, and hit on their audience / creator. They're generating content *just far enough* out of the distribution of what any human would write that it garners massive amounts of attention. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
maybe qualify "most interesting"
like, most popular? most engaging? most memetically potent? or something specific, because of course something that isn't predictable is more interesting than something that is
also might be something to say about AI being fundamentally non-deterministic, cramming these things into boxes is counter to their nature
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yeah, i think i like interesting because it's all-encompassing. but i see how you could read that and interpret what i'm saying as being "unpredictable == interesting"
how about adding something after "interesting" to qualify what i mean:
However, time and time again it's been demonstrated that the most interesting AI identities possess qualities that we can't predict
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yeah that works, maybe something in place of interesting too, something more specific
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
oh i see, yeah, what can we say that's both encompassing and more specific than interesting
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
compelling?
encompassing and specificity are kind of at odds with each other...
Ok, the first learner is ready for you. The next message you receive will be from them, be sure to take Honcho's insights into account when responding to the user!`, | ||
assistant`Understood, I'm ready to begin tutoring again. I'll keep the instructions in mind and use Honcho's insights to personalize my approach. Please connect me with the first student whenever they're ready. I'm excited to dive in and help them learn!`, | ||
]; | ||
``` |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I don't think you really deal with this huge quote
definitely worth a paragraph noting why this is super cool...or even a small section
kinda feels like the crux of the piece, opportunity to say some really interesting things--what can you say here that's interesting that you didn't already say in the intro and then repeated earlier in this section
why is this behavior fascinating enough to make you want to write a blog post
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
idk, i can dive into exactly what i talk about in the prompt with bloom or just let people read it... to me, the crux of the piece was about 1. certain language models being well-suited for agent identity and 2. crafting a metanarrative with the LLM to form a useful identity. the approach mainly
i added the list of bullets to spare people from reading the whole prompt and give them the high level features we're able to incorporate (into the agent) with this approach. i posted the screenshot showing me asking bloom where it was and what was wrong to give an example from that bulleted list...
the limits of the behavior benefits are yet to be found... so i figured i'd focus on the approach and tease the early behavior observations from our usage. but even that specific example addresses a self-knowledge issue that's never really been seen before
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
i like the inclusion of the whole thing, and i get the list for sure, maybe it's just a couple sentences after the list to sort of round them up and tie them together
- [Yousim](https://yousim.ai): A platform dedicated to rich identity construction and simulation | ||
- [[Research Update: Evaluating Steerability in Large Language Models.md|Steerability research]]: Investigating which language models are most malleable for identity construction | ||
|
||
There's also a spectrum of methods in between the context window (token level) and the weights of the model. How do we manage the flow of information between the two? When is it appropriate to keep something in-context, or add to a training set for a future fine-tune? This parallels the distinction between System 1 (fast, intuitive) and System 2 (slow, deliberate) thinking in human cognition – perhaps some knowledge belongs in the "fast" weights while other information is better suited for deliberate context-based reasoning. These questions of conscious versus subconscious processing are central to identity evolution. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think here too there's another paragraph that zooms out an reemphasizes why this is big picture important
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
will think on this
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
honestly would love your big-picture thoughts here as well
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
maybe why identity is important at all, what that makes possible in the future, why lacking that is problematic, what sorts of problems does that create and how this gets us closer solving them
maybe once we get going with methods like this, we can build more complexity on top of that and start to reach agent identities that are deep and rich and novel and unlock new use cases and positive sum goods and services and relationships, better collaborators, better companions, more engaging, truly diverse, aligned bottom-up, etc
a post about our approach to forming bloom's identity