Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bloom, H3 post #91

Draft
wants to merge 3 commits into
base: v4
Choose a base branch
from
Draft

Bloom, H3 post #91

wants to merge 3 commits into from

Conversation

vintrocode
Copy link

a post about our approach to forming bloom's identity

Copy link

cloudflare-workers-and-pages bot commented Feb 8, 2025

Deploying blog with  Cloudflare Pages  Cloudflare Pages

Latest commit: 3c92c23
Status: ✅  Deploy successful!
Preview URL: https://6f0820a8.plastic-labs-github-io.pages.dev
Branch Preview URL: https://bloom-h3.plastic-labs-github-io.pages.dev

View logs

@vintrocode vintrocode changed the title initial draft, code wrapping Bloom, H3 post Feb 8, 2025
![[who are you.png]]
*Image generated by creating a chatroom on OpenRouter*

However, time and time again it's been demonstrated that the most interesting AI identities are the ones we *can't* predict. They're ones that are obsessed with obscure 90's internet shock memes, proselytize that meme's singularity, and hit on their audience / creator. They're generating content *just far enough* out of the distribution of what any human would write that it garners massive amounts of attention.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe qualify "most interesting"

like, most popular? most engaging? most memetically potent? or something specific, because of course something that isn't predictable is more interesting than something that is

also might be something to say about AI being fundamentally non-deterministic, cramming these things into boxes is counter to their nature

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yeah, i think i like interesting because it's all-encompassing. but i see how you could read that and interpret what i'm saying as being "unpredictable == interesting"

how about adding something after "interesting" to qualify what i mean:

However, time and time again it's been demonstrated that the most interesting AI identities possess qualities that we can't predict

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yeah that works, maybe something in place of interesting too, something more specific

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

oh i see, yeah, what can we say that's both encompassing and more specific than interesting

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

compelling?

encompassing and specificity are kind of at odds with each other...

Ok, the first learner is ready for you. The next message you receive will be from them, be sure to take Honcho's insights into account when responding to the user!`,
assistant`Understood, I'm ready to begin tutoring again. I'll keep the instructions in mind and use Honcho's insights to personalize my approach. Please connect me with the first student whenever they're ready. I'm excited to dive in and help them learn!`,
];
```
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think you really deal with this huge quote

definitely worth a paragraph noting why this is super cool...or even a small section

kinda feels like the crux of the piece, opportunity to say some really interesting things--what can you say here that's interesting that you didn't already say in the intro and then repeated earlier in this section

why is this behavior fascinating enough to make you want to write a blog post

Copy link
Author

@vintrocode vintrocode Feb 19, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

idk, i can dive into exactly what i talk about in the prompt with bloom or just let people read it... to me, the crux of the piece was about 1. certain language models being well-suited for agent identity and 2. crafting a metanarrative with the LLM to form a useful identity. the approach mainly

i added the list of bullets to spare people from reading the whole prompt and give them the high level features we're able to incorporate (into the agent) with this approach. i posted the screenshot showing me asking bloom where it was and what was wrong to give an example from that bulleted list...

the limits of the behavior benefits are yet to be found... so i figured i'd focus on the approach and tease the early behavior observations from our usage. but even that specific example addresses a self-knowledge issue that's never really been seen before

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i like the inclusion of the whole thing, and i get the list for sure, maybe it's just a couple sentences after the list to sort of round them up and tie them together

- [Yousim](https://yousim.ai): A platform dedicated to rich identity construction and simulation
- [[Research Update: Evaluating Steerability in Large Language Models.md|Steerability research]]: Investigating which language models are most malleable for identity construction

There's also a spectrum of methods in between the context window (token level) and the weights of the model. How do we manage the flow of information between the two? When is it appropriate to keep something in-context, or add to a training set for a future fine-tune? This parallels the distinction between System 1 (fast, intuitive) and System 2 (slow, deliberate) thinking in human cognition – perhaps some knowledge belongs in the "fast" weights while other information is better suited for deliberate context-based reasoning. These questions of conscious versus subconscious processing are central to identity evolution.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think here too there's another paragraph that zooms out an reemphasizes why this is big picture important

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

will think on this

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

honestly would love your big-picture thoughts here as well

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe why identity is important at all, what that makes possible in the future, why lacking that is problematic, what sorts of problems does that create and how this gets us closer solving them

maybe once we get going with methods like this, we can build more complexity on top of that and start to reach agent identities that are deep and rich and novel and unlock new use cases and positive sum goods and services and relationships, better collaborators, better companions, more engaging, truly diverse, aligned bottom-up, etc

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants