adapt vllm xpu#8

Open

yangw1234 wants to merge 10000 commits intomainfrom vllm-xpu

+1,484,889

This pull request is big! We're only showing the most recent 250 commits

Commits on Feb 6, 2024

Commits on Feb 7, 2024

Commits on Feb 8, 2024

[LLM] Support MLP optimization for Qwen1.5 (intel-analytics#10123 )
Oscilloscope98
authored
Chronos: fix PSIRT issues (intel-analytics#10116 )
plusbang
authored
disable fused layer norm on UHD (intel-analytics#10130 )
MeouSker77
authored
LLM: add default torch_dtype for fp16. (intel-analytics#10124 )
lalalapotter
authored
Orca and dllib: fix PSIRT issue (intel-analytics#10120 )
Zephyr596
authored
LLM: add Modelscope model example (intel-analytics#10126 )
plusbang
authored
LLM: basic support for q2k (intel-analytics#10132 )
rnwang04
authored
[LLM] Enable kv_cache optimization for Qwen2 on transformers-v4.37.0 (intel-analytics#10131 )
sgwhat
authored
add quantize kv cache support for qwen2 (intel-analytics#10134 )
MeouSker77
authored
LLM: add quantize kv cache for llama. (intel-analytics#10086 )
lalalapotter
authored
quick fix qwen2 fp8 kv cache (intel-analytics#10135 )
MeouSker77
authored
Fix code scanning issues (intel-analytics#10129 )
liu-shaojun
authored
In harness-evaluation workflow, add statistical tables (intel-analytics#10118 )
pengyb2001
authored

Commits on Feb 9, 2024

Commits on Feb 19, 2024

Commits on Feb 20, 2024

Commits on Feb 21, 2024

Commits on Feb 22, 2024

Commits on Feb 23, 2024

falcon for transformers 4.36 (intel-analytics#9960 )
songhappy
authored
Bump cryptography from 42.0.2 to 42.0.4 in /python/requirements/nano (intel-analytics#10215 )
dependabot[bot]
authored
Unpin gradio in /ppml/tdx/docker/trusted-bigdl-llm/inference (intel-analytics#10216 )

dependabot[bot]
and
liu-shaojun
authored
Gemma optimization: rms_norm, kv_cache, fused_rope, fused_rope+qkv (intel-analytics#10212 )
qiuxin2012
authored
Move harness nightly related files to llm/test folder (intel-analytics#10209 )
Chen, Zhentao
authored
Update readme (intel-analytics#10214 )
jason-dai
authored
Add CPU and GPU examples of phi-2 (intel-analytics#10014 )
pengyb2001
authored
Add CPU and GPU examples for Yuan2-2B-hf (intel-analytics#9946 )
pengyb2001
authored
[LLM] change IPEX230 to IPEX220 in dockerfile (intel-analytics#10222 )
Jasonzzt
authored
add gemma example (intel-analytics#10224 )
qiuxin2012
authored
LLM: fix action/installation error of mpmath (intel-analytics#10223 )
rnwang04
authored
Fix build error of bigdl-llm-cpu (intel-analytics#10228 )
Jasonzzt
authored
use stable lm to test pr
Chen, Zhentao
committed
remove harness job output
Chen, Zhentao
committed
fix harness installation
Chen, Zhentao
committed
reformat
Chen, Zhentao
committed
fix Run Harness job
Chen, Zhentao
committed
fall back to make_table.py
Chen, Zhentao
committed
separate make_csv from the file
Chen, Zhentao
committed
rewrite html visualization
Chen, Zhentao
committed
remove dependency
Chen, Zhentao
committed
update Gemma readme (intel-analytics#10229 )
qiuxin2012
authored
[LLM] Add basic optimization framework for Yuan2 (intel-analytics#10227 )
Oscilloscope98
authored
fix ACC_FOLDER
Chen, Zhentao
committed
Rename results
Chen, Zhentao
committed
Python style fix (intel-analytics#10230 )
Oscilloscope98
authored
LLM: support fp16 embedding & add mlp fusion for iq2_xxs (intel-analytics#10219 )
rnwang04
authored
fix make_csv.py
Chen, Zhentao
committed
run one job only if triggered by pr
Chen, Zhentao
committed
fix readme
Chen, Zhentao
committed

Commits on Feb 25, 2024

Upgrade Spark to 3.4.1 (intel-analytics#10220 )

liu-shaojun
and
Le-Zheng
authored

Commits on Feb 26, 2024

Commits on Feb 27, 2024

Commits on Feb 28, 2024

Commits on Feb 29, 2024

Commits on Mar 1, 2024

Commits on Mar 3, 2024

Update WebUI quickstart (intel-analytics#10305 )
jason-dai
authored

Commits on Mar 4, 2024

Commits on Mar 5, 2024

Commits on Mar 6, 2024

Commits on Mar 12, 2024

adapt vllm xpu
yangw1234
committed