Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

video processing code failed #25

Open
MengHao666 opened this issue Feb 8, 2025 · 1 comment
Open

video processing code failed #25

MengHao666 opened this issue Feb 8, 2025 · 1 comment

Comments

@MengHao666
Copy link

the code of processing video code is as

elif 'video' in data_dict and data_dict['video'] is not None:

It is inconsistent with the instructions to build dataset in readme file. In reademe file , the "video" is not a list but a string object.


[
    {
        "video": "images/xxx.jpg",
        "conversations": [
            {
                "from": "human",
                "value": "<image>\nWhat are the colors of the bus in the image?"
            },
            {
                "from": "gpt",
                "value": "The bus in the image is white and red."
            },
            ...
        ],
    }
    {
        "video": "videos/xxx.mp4",
        "conversations": [
            {
                "from": "human",
                "value": "<video>\nWhat are the main activities that take place in the video?"
            },
            {
                "from": "gpt",
                "value": "The main activities that take place in the video are the preparation of camera equipment by a man, a group of men riding a helicopter, and a man sailing a boat through the water."
            },
            ...
        ],
    },
    ...
]
@lkhl
Copy link
Collaborator

lkhl commented Feb 10, 2025

Hi @MengHao666. Thanks for the reminder!

The "video" item should be a list. We have fixed this error in the instruction.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants