Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(llm): add ChatContext #120

Merged
merged 8 commits into from
Nov 2, 2024
Merged

feat(llm): add ChatContext #120

merged 8 commits into from
Nov 2, 2024

Conversation

nbsp
Copy link
Member

@nbsp nbsp commented Oct 31, 2024

incomplete implementation, notably missing tool call hooks (see comment
for more info).

incomplete implementation, notably missing tool call hooks (see comment
for more info).
@nbsp nbsp requested a review from theomonnom October 31, 2024 03:48
Copy link

changeset-bot bot commented Oct 31, 2024

🦋 Changeset detected

Latest commit: c4cfdee

The changes in this PR will be included in the next version bump.

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@nbsp nbsp changed the title feat(vad): add Silero VAD, overhaul VAD class (#92) feat(llm): add ChatContext Oct 31, 2024
inferenceWidth?: number;
inferenceHeight?: number;
/** Used by LLM implementations to store a processed version of the image for later use. */
cache: { [id: string | number | symbol]: any };
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

any way to make sure "cache" is private?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

to what degree? LLM needs direct access to it, so we can't make it private or readonly. i can mark is as @internal so it's clear only llms should use it

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

internal sounds good

@nbsp nbsp marked this pull request as ready for review November 1, 2024 05:20
previous_item_id: previousItemId,
});
// create(item: api_proto.ConversationItemCreateContent, previousItemId?: string): void {
create(message: llm.ChatMessage, previousItemId?: string): void {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔥

@nbsp nbsp merged commit 7bdf719 into v0.4.0 Nov 2, 2024
4 checks passed
@nbsp nbsp deleted the nbsp/add/chatcontext branch November 2, 2024 02:40
nbsp added a commit that referenced this pull request Nov 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants