Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Read benchmarks on v6e (read cache + parallel downloads) #2925

Draft
wants to merge 37 commits into
base: master
Choose a base branch
from
Draft
Changes from 1 commit
Commits
Show all changes
37 commits
Select commit Hold shift + click to select a range
88d9c8f
File cache on memory
kislaykishore Nov 22, 2024
d4c8e6d
FIO TPU file cache on disk
kislaykishore Nov 22, 2024
1ccebe5
Remove memory limits
kislaykishore Dec 7, 2024
740fe1f
nec changes
anushka567 Dec 10, 2024
ea41001
fio workload also
anushka567 Dec 11, 2024
010cc49
adding node affinity
anushka567 Dec 12, 2024
11584fb
increasing num nodes in each pool to ensure parallel pod scheduling
anushka567 Dec 12, 2024
35926f5
making namespace configurable
anushka567 Dec 12, 2024
b4ecc90
tweaks for running paralley namespace/instanceid/nodepool
anushka567 Dec 12, 2024
6bc4d2c
fixes in log parsing
anushka567 Dec 12, 2024
b70ad35
buffer on mmemory
anushka567 Dec 12, 2024
eeac1ca
making script configurable
anushka567 Dec 13, 2024
ee9bd8b
making everything configurable
anushka567 Dec 13, 2024
9e4f70d
correcting namespace
anushka567 Dec 13, 2024
83792c3
correcting pod yaml
anushka567 Dec 13, 2024
701c004
fix
anushka567 Dec 13, 2024
993d1c2
workloads for parallel downloads
anushka567 Jan 21, 2025
1dea023
overall commands script
anushka567 Jan 21, 2025
b44b320
fio tester
anushka567 Jan 21, 2025
7d19a4e
values.yaml
anushka567 Jan 21, 2025
dd7c94b
run tests
anushka567 Jan 21, 2025
0298842
run gke tests
anushka567 Jan 21, 2025
9d2a55a
cmd update
anushka567 Jan 21, 2025
d7946b8
fix
anushka567 Jan 21, 2025
1fafe55
fix2
anushka567 Jan 21, 2025
0208b03
changes to pod yaml
anushka567 Jan 22, 2025
1993821
filecacheconfig option
anushka567 Jan 22, 2025
85f0a6c
metadatacachett to -1
anushka567 Jan 23, 2025
b65fd08
split workload
anushka567 Jan 23, 2025
5c8c4bb
boot disk size change
anushka567 Jan 23, 2025
10e99c6
ldap replace
anushka567 Jan 23, 2025
31d09a6
nmspc
anushka567 Jan 23, 2025
79fa63d
configure correct namespace
anushka567 Jan 23, 2025
af7cee9
setup before the run
anushka567 Jan 24, 2025
41384b6
inc pod active dedline
anushka567 Jan 24, 2025
ff0bf19
updated workload
anushka567 Jan 25, 2025
d76b5ea
updated workload 2
anushka567 Jan 25, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
correcting pod yaml
anushka567 committed Dec 13, 2024
commit 83792c3b0569aad54616414c235e06cee5a89d96
Original file line number Diff line number Diff line change
@@ -111,14 +111,14 @@ spec:
- name: gke-gcsfuse-cache
emptyDir:
medium: Memory
{{ - if eq .Values.bufferLocation "bootDisk" }}
{{ if eq .Values.bufferLocation "bootDisk" }}
- name: gke-gcsfuse-buffer
emptyDir: {}
{ { - else if eq .Values.bufferLocation "memory" } }
{ { else if eq .Values.bufferLocation "memory" } }
- name: gke-gcsfuse-buffer
emptyDir:
medium: Memory
{ { - end } }
{ { end } }
- name: gke-gcsfuse-tmp
emptyDir:
medium: Memory
Original file line number Diff line number Diff line change
@@ -167,14 +167,14 @@ spec:
volumes:
- name: gke-gcsfuse-cache
emptyDir: {}
{{ - if eq .Values.bufferLocation "bootDisk" }}
{{ if eq .Values.bufferLocation "bootDisk" }}
- name: gke-gcsfuse-buffer
emptyDir: {}
{ { - else if eq .Values.bufferLocation "memory" } }
{ { else if eq .Values.bufferLocation "memory" } }
- name: gke-gcsfuse-buffer
emptyDir:
medium: Memory
{ { - end } }
{ { end } }
- name: gke-gcsfuse-tmp
emptyDir: {}
- name: dshm