Skip to content

Commit

Permalink
Merge pull request #36 from kuleshov-group/oseyosey-patch-1
Browse files Browse the repository at this point in the history
Update README.md
  • Loading branch information
oseyosey authored Apr 15, 2024
2 parents ec2b0c7 + 7ecadc9 commit 0ec1d28
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,8 @@ LLMTools implements low precision LoRA, a new memory-efficient finetuning algori

For a detailed walk through of LLMTools and ModuLoRA, please refer to our [**Blog Post**](https://oseyincs.io/llmtools/).

Previous release of LLMTools can be found [here](https://github.com/kuleshov-group/llmtools/tree/llmtools-optq), where we integrate OPTQ as our quantization module. We will integrate two release shortly.

_Please open a GitHub ticket if you have any questions about the code or ModuLoRA in general._

## Overview
Expand Down Expand Up @@ -124,6 +126,7 @@ To ensure maximum reproducibility, consider creating a new conda environment:
```python
conda create -n llmtools python=3.9.18
conda activate llmtools
pip install torch==2.1.1 torchvision==0.16.1 torchaudio==2.1.1 --index-url https://download.pytorch.org/whl/cu121
cd llmtools/third-party/quip
python -m pip install -r requirements.txt
cd ../../
Expand Down

0 comments on commit 0ec1d28

Please sign in to comment.