LLM-Finetuning

Running LLM Finetuning using BigDL-LLM on Intel GPU

This folder contains examples of running different training mode with BigDL-LLM on Intel GPU:

• LoRA: examples of running LoRA finetuning
• QLoRA: examples of running QLoRA finetuning
• QA-LoRA: examples of running QA-LoRA finetuning
• ReLora: examples of running ReLora finetuning
• DPO: examples of running DPO finetuning
• common: common templates and utility classes in finetuning examples

Troubleshooting

• If you fail to finetune on multi cards because of following error message:

  RuntimeError: oneCCL: comm_selector.cpp:57 create_comm_impl: EXCEPTION: ze_data was not initialized

  Please try sudo apt install level-zero-dev to fix it.

• Please raise the system open file limit using ulimit -n 1048576. Otherwise, there may exist error Too many open files.