Skip to content

Issues: DAMO-NLP-SG/VideoLLaMA2

🚀 [Release Notes] 2024.10
#116 opened Oct 26, 2024 by lixin4ever
Open
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

53 Open 61 Closed
53 Open 61 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

stage3_video_audio.json data
#136 opened Dec 21, 2024 by G-JWLee
The AVQA accuracy is lower than that reported in the paper.
#135 opened Dec 17, 2024 by wyh2000
Alert: Some weights of Videollama2MistralForCausalLM were not initialized from the model checkpoint at checkpoints/Mistral-7B-Instruct-v0.2 and are newly initialized: ['model.mm_projector.readout.0.bias', 'model.mm_projector.readout.0.weight', ...... 'model.mm_projector.sampler.0.weight']
#132 opened Nov 30, 2024 by LiangMeng89
Online Demo
#131 opened Nov 30, 2024 by LIU020174
1
Quick question on the need for KeywordsStoppingCriteria
#130 opened Nov 30, 2024 by sramakintel
Can't download the pretrained audio encoder
#129 opened Nov 28, 2024 by Huskyii24
1
Finetune model inference error
#124 opened Nov 20, 2024 by thisurawz1
3
Error When Running Multiple-model Version Demo
#120 opened Nov 3, 2024 by shmooel28
1
No module named 'transformers'
#117 opened Oct 27, 2024 by 0sATs0
2
🚀 [Release Notes] 2024.10 enhancement New feature or request good first issue Good for newcomers
#116 opened Oct 26, 2024 by lixin4ever
Inference code does not work for videos
#114 opened Oct 25, 2024 by marvlyngkhoi
3
How to load model model that was finetuned using qlora or lora?
#113 opened Oct 25, 2024 by marvlyngkhoi
1
Can't hear the audio
#112 opened Oct 25, 2024 by sjghh
12
QLoRA fin-tunes a custom model with 4-bits, and inference the video, then we got :
#106 opened Oct 20, 2024 by BUAACY
1
Forward pass of the model - how to pass videos?
#105 opened Oct 19, 2024 by esh04
1
Request for Inference Code on Custom Datasets
#101 opened Oct 2, 2024 by dongqi-me
6
code for batch inference
#97 opened Sep 23, 2024 by zhangjic22
1
Can I run VideoLLaMA 1 in this repo?
#94 opened Sep 19, 2024 by jun297
1
Videochatgpt_gen link for Test_Human_Annotated_Captions is not valid
#91 opened Sep 13, 2024 by jun297
2
ValueError: The following model_kwargs are not used by the model: ['images_or_videos', 'modal_list']
#90 opened Sep 12, 2024 by CaffeyChen
2
After fine-tuning, the model outputs repetitive phrases
#89 opened Sep 11, 2024 by Jackyzjz
4
Could you please advise when the checkpoint for the audio branch will be made public?
#87 opened Sep 4, 2024 by ymxyll
6
Deployment on huggingface endpoints
#86 opened Sep 3, 2024 by aliayub40995
2
Cannot reproduce results on vllava datasets good first issue Good for newcomers
#81 opened Aug 27, 2024 by williamium3000
27
Unable to load *ANY BASE MODEL* in 4bit
#78 opened Aug 20, 2024 by ApoorvFrontera
2
ProTip! Mix and match filters to narrow down what you’re looking for.