Skip to content

Commit

Permalink
fix readme
Browse files Browse the repository at this point in the history
  • Loading branch information
huseinzol05 committed May 2, 2024
1 parent 34f730b commit 1c54950
Showing 1 changed file with 2 additions and 4 deletions.
6 changes: 2 additions & 4 deletions session/llama3/README.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# Finetune Gemma
# Finetune Llama-3

## Flash Attention 2

Expand All @@ -16,11 +16,9 @@ Dataset prepared at https://github.com/malaysia-ai/text-dataset-dedup/tree/main/
### 8B, 8192 Context length

```bash
bash train-7b.sh
bash train-8b.sh
```

https://wandb.ai/huseinzol05/finetune-gemma-7b?workspace=user-huseinzol05

## Full Parameter Finetuning

```bash
Expand Down

0 comments on commit 1c54950

Please sign in to comment.