Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add VLM scripts and CI tests #11383

Open
wants to merge 37 commits into
base: main
Choose a base branch
from
Open

Add VLM scripts and CI tests #11383

wants to merge 37 commits into from

Commits on Nov 19, 2024

  1. update recipe 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33 @ko3n1g
    yaoyu-33 authored and ko3n1g committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    e3ca50f View commit details
    Browse the repository at this point in the history

  2. fix mllama mock ds 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33 @ko3n1g
    yaoyu-33 authored and ko3n1g committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    c935e97 View commit details
    Browse the repository at this point in the history

  3. update to use attention bias 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33 @ko3n1g
    yaoyu-33 authored and ko3n1g committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    389f148 View commit details
    Browse the repository at this point in the history

  4. remove example 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33 @ko3n1g
    yaoyu-33 authored and ko3n1g committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    12e6a45 View commit details
    Browse the repository at this point in the history

  5. Apply isort and black reformatting 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33 @ko3n1g
    yaoyu-33 authored and ko3n1g committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    98ab3a5 View commit details
    Browse the repository at this point in the history

  6. fix docstring mock.py 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33 @ko3n1g
    yaoyu-33 authored and ko3n1g committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    bae1e22 View commit details
    Browse the repository at this point in the history

  7. fix docstring language.py 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33 @ko3n1g
    yaoyu-33 authored and ko3n1g committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    db755f2 View commit details
    Browse the repository at this point in the history

  8. Apply isort and black reformatting 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33 @ko3n1g
    yaoyu-33 authored and ko3n1g committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    3f5f478 View commit details
    Browse the repository at this point in the history

  9. fix docstring language.py 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33 @ko3n1g
    yaoyu-33 authored and ko3n1g committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    fbd71ab View commit details
    Browse the repository at this point in the history

  10. Apply isort and black reformatting 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33 @ko3n1g
    yaoyu-33 authored and ko3n1g committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    d967646 View commit details
    Browse the repository at this point in the history

  11. fix docstring mllama/base.py 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33 @ko3n1g
    yaoyu-33 authored and ko3n1g committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    cd15326 View commit details
    Browse the repository at this point in the history

  12. Apply isort and black reformatting 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33 @ko3n1g
    yaoyu-33 authored and ko3n1g committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    1fea80d View commit details
    Browse the repository at this point in the history

  13. Apply isort and black reformatting 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33 @ko3n1g
    yaoyu-33 authored and ko3n1g committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    01fccf4 View commit details
    Browse the repository at this point in the history

  14. fix docstring mllama/language.py 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33 @ko3n1g
    yaoyu-33 authored and ko3n1g committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    908079c View commit details
    Browse the repository at this point in the history

  15. bump mcore 

    Signed-off-by: Oliver Koenig <[email protected]>
    @ko3n1g
    ko3n1g committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    6373da2 View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2024

  1. Merge branch 'main' into yuya/update_mllama_use_attn_bias

    @yaoyu-33
    yaoyu-33 authored Nov 21, 2024
    Configuration menu
    Copy the full SHA
    3a3bc62 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into yuya/update_mllama_use_attn_bias

    @yaoyu-33
    yaoyu-33 authored Nov 21, 2024
    Configuration menu
    Copy the full SHA
    1fd657a View commit details
    Browse the repository at this point in the history

  3. Add scripts for mllama 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33
    yaoyu-33 committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    67bd26c View commit details
    Browse the repository at this point in the history

  4. fix 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33
    yaoyu-33 committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    f94915a View commit details
    Browse the repository at this point in the history

  5. Apply isort and black reformatting 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33
    yaoyu-33 committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    dcd8ac6 View commit details
    Browse the repository at this point in the history

  6. update script 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33
    yaoyu-33 committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    d88d182 View commit details
    Browse the repository at this point in the history

  7. Merge remote-tracking branch 'origin/yuya/update_mllama_use_attn_bias… 

    …' into yuya/update_mllama_use_attn_bias
    @yaoyu-33
    yaoyu-33 committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    e76f25d View commit details
    Browse the repository at this point in the history

  8. fix pylint 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33
    yaoyu-33 committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    dd72cf4 View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2024

  1. Merge branch 'main' into yuya/update_mllama_use_attn_bias

    @yaoyu-33
    yaoyu-33 authored Nov 22, 2024
    Configuration menu
    Copy the full SHA
    2c28ad6 View commit details
    Browse the repository at this point in the history

  2. revert Dockerfile.ci 

    Signed-off-by: Yu Yao <[email protected]>
    @yaoyu-33
    yaoyu-33 authored Nov 22, 2024
    Configuration menu
    Copy the full SHA
    ec1ebac View commit details
    Browse the repository at this point in the history

  3. add scripts 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33
    yaoyu-33 committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    653d4c8 View commit details
    Browse the repository at this point in the history

  4. add vlm training test in ci 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33
    yaoyu-33 committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    f0c0424 View commit details
    Browse the repository at this point in the history

  5. Apply isort and black reformatting 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33
    yaoyu-33 committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    4266e30 View commit details
    Browse the repository at this point in the history

  6. fix docstring issues 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33
    yaoyu-33 committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    1a283aa View commit details
    Browse the repository at this point in the history

  7. update script match recipe 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33
    yaoyu-33 committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    6b2b5e9 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'refs/heads/yuya/update_mllama_use_attn_bias' into yuya/… 

    …add_neva_scripts_and_tests
    @yaoyu-33
    yaoyu-33 committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    b733811 View commit details
    Browse the repository at this point in the history

  9. update recipes 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33
    yaoyu-33 committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    29572dd View commit details
    Browse the repository at this point in the history

  10. Update mllama_train.py 

    Signed-off-by: Yu Yao <[email protected]>
    @yaoyu-33
    yaoyu-33 authored Nov 22, 2024
    Configuration menu
    Copy the full SHA
    16a6fc6 View commit details
    Browse the repository at this point in the history

  11. update mllama 90b recipe 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33
    yaoyu-33 committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    05f3cb6 View commit details
    Browse the repository at this point in the history

  12. Merge branch 'refs/heads/yuya/update_mllama_use_attn_bias' into yuya/… 

    …add_neva_scripts_and_tests
    @yaoyu-33
    yaoyu-33 committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    617c8ca View commit details
    Browse the repository at this point in the history

  13. update to use tmp in ci tests 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33
    yaoyu-33 committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    8344cc9 View commit details
    Browse the repository at this point in the history

  14. update default llava config 

    Signed-off-by: yaoyu-33 <[email protected]>
    @yaoyu-33
    yaoyu-33 committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    0d2d916 View commit details
    Browse the repository at this point in the history