-
Notifications
You must be signed in to change notification settings - Fork 71
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat(llm): add ChatContext #120
Conversation
incomplete implementation, notably missing tool call hooks (see comment for more info).
🦋 Changeset detectedLatest commit: c4cfdee The changes in this PR will be included in the next version bump. Not sure what this means? Click here to learn what changesets are. Click here if you're a maintainer who wants to add another changeset to this PR |
inferenceWidth?: number; | ||
inferenceHeight?: number; | ||
/** Used by LLM implementations to store a processed version of the image for later use. */ | ||
cache: { [id: string | number | symbol]: any }; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
any way to make sure "cache" is private?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
to what degree? LLM needs direct access to it, so we can't make it private or readonly. i can mark is as @internal
so it's clear only llms should use it
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
internal sounds good
previous_item_id: previousItemId, | ||
}); | ||
// create(item: api_proto.ConversationItemCreateContent, previousItemId?: string): void { | ||
create(message: llm.ChatMessage, previousItemId?: string): void { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
🔥
incomplete implementation, notably missing tool call hooks (see comment
for more info).