From 5ab8d2ee4947a38c25cae26456fd55d9388b947a Mon Sep 17 00:00:00 2001
From: Adlith <adlith@163.com>
Date: Mon, 21 Oct 2024 20:08:00 +0800
Subject: [PATCH] Update README.md

---
 README.md | 13 +++++++++++--
 1 file changed, 11 insertions(+), 2 deletions(-)

diff --git a/README.md b/README.md
index a9a8988..0220efa 100644
--- a/README.md
+++ b/README.md
@@ -147,10 +147,19 @@ MoE-Jetpack/
 
 
 ### 🗝️ Training & Validating
-* The training & Testing code is built on [MMPretrain](https://github.com/open-mmlab/mmpretrain). Please refer to [Training Doc](https://mmpretrain.readthedocs.io/en/latest/user_guides/train.html#train) for more details.
+
+#### 1. Initialize MoE Weights (Checkpoint Recycling)
+Run the following script to initialize the MoE weights from pre-trained ViT weights:
+
+```bash
+python moejet/tools/gen_ViT_MoE_weight.py
+```
+#### 2. Start Training
+
+* The training and testing code is built on [MMPretrain](https://github.com/open-mmlab/mmpretrain). Please refer to the [Training Documentation](https://mmpretrain.readthedocs.io/en/latest/user_guides/train.html#train) for more details.
 
 ```python
-# For example, train MoE Jet on Imgnet-1K
+# For example, to train MoE Jet on ImageNet-1K, use:
 
 CUDA_VISIBLE_DEVICES=0,1,2,3 PORT=29500 ./tools/dist_train.sh moejet/configs/timm/vit_tiny_dual_moe_timm_21k_ft.py 4
 ```