Code

Benchmarking prefix cache routing#390

Code

Merged

samos123 merged 22 commits intomainsubstratusai/kubeai:mainfrom benchmarking-prefix-cache-routingsubstratusai/kubeai:benchmarking-prefix-cache-routingCopy head branch name to clipboardFeb 12, 2025

+2,478-2

Commits

Commits on Feb 10, 2025

• add benchmarking script

  samos123

  committed
  a736146

  Copy full SHA for a736146

• add current state

  samos123

  committed
  d109456

  Copy full SHA for d109456

• update results

  samos123

  committed
  4f29f0b

  Copy full SHA for 4f29f0b

• remove archived part

  samos123

  committed
  015baf7

  Copy full SHA for 015baf7

• download dataset using curl

  samos123

  committed
  a4fb219

  Copy full SHA for a4fb219

• update

  samos123

  committed
  d9516a7

  Copy full SHA for d9516a7

• update write up

  samos123

  committed
  3a631c5

  Copy full SHA for 3a631c5

• update text

  samos123

  committed
  87f50f9

  Copy full SHA for 87f50f9

Commits on Feb 11, 2025

• update with k8s native

  samos123

  committed
  3ecf8af

  Copy full SHA for 3ecf8af

• update graph

  samos123

  committed
  1689476

  Copy full SHA for 1689476

• add doc

  samos123

  committed
  5389dea

  Copy full SHA for 5389dea

• add more details about dataset

  samos123

  committed
  8d5ebbd

  Copy full SHA for 8d5ebbd

• update README

  samos123

  committed
  b30340e

  Copy full SHA for b30340e

• add direct service

  samos123

  committed
  0ba9330

  Copy full SHA for 0ba9330

• update README

  samos123

  committed
  d11307c

  Copy full SHA for d11307c

• update README

  samos123

  committed
  78f355e

  Copy full SHA for 78f355e

• reduce width

  samos123

  committed
  ddc0b61

  Copy full SHA for ddc0b61

Commits on Feb 12, 2025

• rename directory benchmark_serving chat-py

  samos123

  committed
  a705604

  Copy full SHA for a705604

• add url

  samos123

  committed
  3f7ccd7

  Copy full SHA for 3f7ccd7

• address PR comments

  samos123

  committed
  4498b7b

  Copy full SHA for 4498b7b

• fix path

  samos123

  committed
  78a3558

  Copy full SHA for 78a3558

• update README

  samos123

  committed
  b222f10

  Copy full SHA for b222f10