此项目是我个人对MIT 6.5940 课程作业的答案,学习笔记和心得。
主要包含以下内容:
- Pruning and Sparsity (模型剪枝)
- Quantization (模型量化)
- Neural Architecture Search (网络架构自动搜索)
- Knowledge Distillation (知识蒸馏)
- Transformer and LLM
- GAN, Video, and Point Cloud
- Diffusion Model
- Efficient Fine-tuning and Prompt Engineering
- Distributed Training