Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Anirud/multi modal model support #169

Open
wants to merge 26 commits into
base: dev
Choose a base branch
from
Open

Anirud/multi modal model support #169

wants to merge 26 commits into from
+855 −202

Conversation

anirudTT
Copy link
Contributor

@anirudTT anirudTT commented Feb 5, 2025

No description provided.

anirudTT added 20 commits February 1, 2025 11:06
@anirudTT
fix ts bug
2fd3f66
@anirudTT
add console log
73054b4
@anirudTT
adds support to input area to allow for file upload
ef5b69f
@anirudTT
adds flow to send over base64 files to model
cc15d37
@anirudTT
add support to show model names in rag management table
f7c98e3
@anirudTT
add icon + have it look similar to models deployed table
cfc272e
@anirudTT
add updates to handle uploading image file
5d915f7
@anirudTT
adds new file data + url ts props
b8cf48c
@anirudTT
add utility file to handle upload and encode images to base64
bc04cbe
@anirudTT
modify to support showing images
71266e7
@anirudTT
fix upload open / close in input area
e9de052
@anirudTT
modify to: If files are uploaded or url are sent, to use new message …
2dc79ae 
…structure
@anirudTT
update 11b vision to new image tag from tt-inference-server
4838ae5
@anirudTT
add image linking component
e86bd8e
@anirudTT
show image as a link preview in chat thread
c278b97
@anirudTT
adds some improvements
249d492
@anirudTT
allow url / links to be passed in correct post structure
84bac19
@anirudTT
add better user feedback to input upload area
988f961
@anirudTT
add tooltips to upload icon to help convey to the user
e3f4fd5
@anirudTT
add better error feedback on uploads
1819745
@anirudTT anirudTT mentioned this pull request Feb 6, 2025
Open
@anirudTT anirudTT marked this pull request as ready for review February 7, 2025 16:16
@anirudTT
Copy link
Contributor Author

anirudTT commented Feb 7, 2025

Marking this for review just for testing for demos

bgoelTT
bgoelTT reviewed Feb 8, 2025
View reviewed changes
Copy link
Contributor

@bgoelTT bgoelTT left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Haven't looked at any of the code yet. But if a prompt is provided as well as an image, the default prompt is still used.
Screenshot 2025-02-08 at 6 39 24 PM

@anirudTT
adds features for the image sent via user:
94b0757 
- to be minimized or maximized
- opened via a dialog box
@anirudTT
- adds border bettwen image and text in chat thread
e555810 
- also add background blur when image is open in max view
- adds z index for the image dialog box
@anirudTT
change default prompt to allow user prompt + image to be passed to model
b6a1c10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@bgoelTT bgoelTT bgoelTT left review comments

@tstescoTT tstescoTT Awaiting requested review from tstescoTT

@mvanniasingheTT mvanniasingheTT Awaiting requested review from mvanniasingheTT

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@anirudTT @bgoelTT