Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MNN:Sync: Sync Internal 2.9.3 #2963

Merged
merged 2 commits into from
Jul 23, 2024
Merged

MNN:Sync: Sync Internal 2.9.3 #2963

merged 2 commits into from
Jul 23, 2024

Conversation

jxt1234
Copy link
Collaborator

@jxt1234 jxt1234 commented Jul 22, 2024

  1. Android 设备上 CPU支持绑核及按容量衰减:power = high 时绑定大核,power = low 时绑定小核;CPU大中小核默认衰减率为 50% ,可通过 CPU_LITTLECORE_DECREASE_RATE 的 hint 值调整
  2. CPU 支持 Block 量化的 Int8 - (Int8 / Int4)计算
  3. BF16计算重构:考虑到BF16的精度问题,限制 BF16 仅在矩阵乘相关算子中使用(Convolution/Deconvolution/MatMul/LSTM/GRU)
  4. LLM支持KV Cache 复用(需要对应模型支持,比如通义千问)和 KV Cache 量化
  5. 优化 OpenCL 后端 Diffusion 运行性能,完善了MNN-Diffusion相关文档

@CLAassistant
Copy link

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.


xiaying seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
You have signed the CLA already but the status is still pending? Let us recheck it.

@jxt1234 jxt1234 force-pushed the feature/sync branch 2 times, most recently from 92d349a to 1c98d58 Compare July 22, 2024 12:28
@jxt1234 jxt1234 merged commit 11a65d7 into master Jul 23, 2024
14 of 15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants