Issue on Colab demo

[pcasagranda]

An issue trying Fauno-Italian_LLM on Colab.

import transformers

cannot be completed because of the following error:
ImportError: accelerate>=0.20.3 is required for a normal functioning of this module, but found accelerate==0.18.0. Try: pip install transformers -U or pip install -e '.[dev]' if you're working with git main

[filippotoso]

I have the same issue locally.

[andreabac3]

Hi,
Sorry to be late, I miss the notification! @pcasagranda @filippotoso

I fixed it by replacing the install line with the following one:

! pip3 install datasets==2.11.0 loralib sentencepiece git+https://github.com/huggingface/transformers.git accelerate==0.20.3 bitsandbytes==0.37.2 git+https://github.com/huggingface/peft.git gradio appdirs

I will update the Colab and notebook as well.

Thanks for using Fauno :)

[SepuWeb]

Hi, now when I execute "Model setup" return this error:

ImportError: cannot import name 'is_npu_available' from 'accelerate.utils'
(/usr/local/lib/python3.10/dist-packages/accelerate/utils/init.py)

[andreabac3]

Hello @SepuWeb,
Are you running on Colab or your machine?

Kind regards,
Andrea

[SepuWeb]

I'm trying the demo on Colab

[filippotoso]

The Colab is still broken. I tried locally and it fails with the same error.

[pcasagranda]

The Colab is still broken, the details below:

INFO: pip is looking at multiple versions of peft to determine which version is compatible with other requirements. This could take a while.
ERROR: Cannot install accelerate==0.20.3 and peft==0.6.0.dev0 because these package versions have conflicting dependencies.

The conflict is caused by:
    The user requested accelerate==0.20.3
    peft 0.6.0.dev0 depends on accelerate>=0.21.0

To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict

ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts