[Wait for #2286] [SWAP] Implement inference mode#2300

Closed

jihochu wants to merge 17 commits intonnstreamer:mainfrom jihochu:picogpt_swap

+183,052-134

Commits on Aug 25, 2023

[cache_pool] bug fix request memory

lhs8928
authored and
jijoongmoon
committed
[attention] add scaled dot product on attention layer

lhs8928
authored and
jijoongmoon
committed
[Poc] implement reinitialize

lhs8928
authored and
jijoongmoon
committed
[PoC] implements PicoGPT

lhs8928
authored and
jijoongmoon
committed
[WIP][POC] Implements picoGPT Encoder

DonghakPark
authored and
jijoongmoon
committed
[PoC] Add User Input, Comment

DonghakPark
authored and
jijoongmoon
committed
[ Applciation ] PicoGPT Android Applciation with NNTrainer
jijoongmoon
committed
[PoC] incremental inference

lhs8928
authored and
jijoongmoon
committed
[concat] enable incremental forwarding with multi threads

lhs8928
authored and
jijoongmoon
committed
[Application] apply incremental inference to pico gpt

lhs8928
authored and
jijoongmoon
committed
[ Application ] Fix for running GPT
jijoongmoon
committed
[ FP16 ] Run PicoGPT with W16A16
jijoongmoon
committed

Commits on Aug 28, 2023

[ PicoGPT ] Enable memory optimiation for picoGPT
jijoongmoon
committed

Commits on Aug 31, 2023

[SWAP] Add swap mode property
jihochu
committed

Commits on Sep 1, 2023

[SWAP] Add inference mode
jihochu
committed

Commits on Sep 7, 2023