Adding results from the Renaissance benchmark

Renaissance/Readme.md

@@ -0,0 +1,53 @@
+This directory contains the experiment results of the Renaissance Benchmark taking Prometheus Metrics.
+# Prereuisites
+To generate the results from the Renaissance Benchmark,we need to:  
+
+ Firstly,install a kubernetes cluster(here minikube) and prometheus which can be done from the [Autotune Installation](https://github.com/kruize/autotune/blob/master/docs/autotune_install.md). 
+
+ Secondly we need to clone the scripts required for running the renaissance benchmark which can be done from [Benchmarks](https://github.com/Prakalp23/benchmarks/tree/renaissance) repository.This contains a number of performance scripts that we have built for the Renaissance benchmark to collect the data from the Prometheus metrics and parse the results.
+ Then,clone this repo for a reference to results and for getting the Python scripts to determine the accuracy of various ML algorithms on the dataset collected
+
+ `git clone https://github.com/Prakalp23/autotune-results.git`
+
+ You,also need to pull the docker image of renaissance onto your local system
+
+  Download a driver (docker or podman)
+
+ [Docker](https://docs.docker.com/engine/install/)
+
+ [Podman](https://podman.io/getting-started/installation)
+
+ Use the installed driver to pull the Renaissance docker image
+
+ `podman pull prakalp23/renaissance1041:latest`
+
+ `docker pull prakalp23/renaissance1041:latest`
+ # For Running The Benchmark
+
+ Start the minikube cluster,here we use podman as a driver,you can use a driver of your choice
+
+ `minikube start --driver=podman`
+
+ Then you need to head over to the directory where the performance scripts are located
+
+ `cd ./perf`
+
+ Then,you need to run the below command to trigger a run with the numbers of warmups measures and iterations being your choice,also the cpu and memory to be used can be set by the user
+
+ `./renaissance-run.sh --clustertype=minikube -s localhost -e ./results -w 1 -m 1 -i 1 --iter=1 -r -n default  --cpureq=1.5 --memreq=3152M --cpulim=1.5 --memlim=3152M -b "page-rank" -g prakalp23/renaissance1041:latest -d 60`
+
+ Here giving -g and the image name is a must as without that the run won't work.
+
+ Renaissance is a collection of many different microbenchmarks such as page-rank,naive-bayes,log-regression more details can be found on [Renaissance Benchmark](https://github.com/renaissance-benchmarks/renaissance)
+
+ To specify a particular benchmark such as naive-bayes in place of page-rank we can use
+
+ `./renaissance-run.sh --clustertype=minikube -s localhost -e ./results -w 5 -m 5 -i 1 --iter=3 -r -n default   -b "naive-bayes" -g prakalp23/renaissance1041:latest -d 60`
+
+ The details about each command such as -s -g can be found inside the scripts in benchmarks repo [Benchmarks](https://github.com/Prakalp23/benchmarks/tree/renaissance)
+
+ After the results are generated use the featurizer.py to turn the data into a csv format and the model.py to perform Accuracy testing of ML Algorithms on the csv file
+
+ To further understand the flow of the project,refer the presentation present on this repository..
+
+ `

Renaissance/exp_results/db-shootout/ITR-0/cnetreceivebytes-measure-0.json

@@ -0,0 +1,5 @@
+  "1661249760.196;20.633333333333333"
+  "1661249775.373;10.833333333333334"
+  "1661249790.451;10.833333333333334"
+  "1661249805.599;37.63333333333333"
+  "1661249820.713;37.63333333333333"

Renaissance/exp_results/db-shootout/ITR-0/cnetreceivebytes-measure-1.json

@@ -0,0 +1,5 @@
+  "1661249821.321;37.63333333333333"
+  "1661249836.463;10.1"
+  "1661249851.551;10.1"
+  "1661249866.705;38.666666666666664"
+  "1661249881.806;38.666666666666664"

Renaissance/exp_results/db-shootout/ITR-0/cnetreceivebytes-measure-2.json

@@ -0,0 +1,5 @@
+  "1661249882.389;38.666666666666664"
+  "1661249897.525;10.7"
+  "1661249912.681;10.7"
+  "1661249927.784;42.13333333333333"
+  "1661249942.81;42.13333333333333"

Renaissance/exp_results/db-shootout/ITR-0/cnetreceivebytes-measure-3.json

@@ -0,0 +1,5 @@
+  "1661249943.461;42.13333333333333"
+  "1661249958.559;10.333333333333334"
+  "1661249973.668;10.333333333333334"
+  "1661249988.69;28.866666666666667"
+  "1661250003.778;28.866666666666667"

Renaissance/exp_results/db-shootout/ITR-0/cnetreceivebytes-measure-4.json

@@ -0,0 +1,5 @@
+  "1661250004.509;28.866666666666667"
+  "1661250019.636;21.099999999999998"
+  "1661250034.693;21.1"
+  "1661250049.803;30.366666666666667"
+  "1661250064.854;30.366666666666667"

Renaissance/exp_results/db-shootout/ITR-0/cnetreceivebytes-warmup-0.json

@@ -0,0 +1,5 @@
+  "1661249454.866;2.2666666666666666"
+  "1661249469.994;11.133333333333335"
+  "1661249485.139;11.133333333333333"
+  "1661249500.332;17.533333333333335"
+  "1661249515.463;17.533333333333335"

Renaissance/exp_results/db-shootout/ITR-0/cnetreceivebytes-warmup-1.json

@@ -0,0 +1,5 @@
+  "1661249515.944;17.533333333333335"
+  "1661249531.007;29.1"
+  "1661249546.075;29.1"
+  "1661249561.15;19.5"
+  "1661249576.211;19.5"

Renaissance/exp_results/db-shootout/ITR-0/cnetreceivebytes-warmup-2.json

@@ -0,0 +1,5 @@
+  "1661249577.015;19.5"
+  "1661249592.164;31.166666666666668"
+  "1661249607.395;31.166666666666668"
+  "1661249622.454;19.233333333333334"
+  "1661249637.605;19.233333333333334"

Renaissance/exp_results/db-shootout/ITR-0/cnetreceivebytes-warmup-3.json

@@ -0,0 +1,5 @@
+  "1661249638.145;19.233333333333334"
+  "1661249653.273;30.133333333333333"
+  "1661249668.445;30.133333333333333"
+  "1661249683.632;19.766666666666666"
+  "1661249698.803;19.766666666666666"

Renaissance/exp_results/db-shootout/ITR-0/cnetreceivebytes-warmup-4.json

@@ -0,0 +1,5 @@
+  "1661249699.204;19.766666666666666"
+  "1661249714.322;30.033333333333335"
+  "1661249729.402;30.033333333333335"
+  "1661249744.517;20.63333333333333"
+  "1661249759.558;20.633333333333333"

Renaissance/exp_results/db-shootout/ITR-0/cnettransmitbytes-measure-0.json

@@ -0,0 +1,5 @@
+  "1661249760.233;11.3"
+  "1661249775.375;6.166666666666668"
+  "1661249790.487;6.166666666666667"
+  "1661249805.565;15.433333333333334"
+  "1661249820.703;15.433333333333334"

Renaissance/exp_results/db-shootout/ITR-0/cnettransmitbytes-measure-1.json

@@ -0,0 +1,5 @@
+  "1661249821.312;15.433333333333334"
+  "1661249836.435;4.1"
+  "1661249851.466;4.1"
+  "1661249866.589;16.9"
+  "1661249881.652;16.9"

Renaissance/exp_results/db-shootout/ITR-0/cnettransmitbytes-measure-2.json

@@ -0,0 +1,5 @@
+  "1661249882.367;16.9"
+  "1661249897.473;5.4"
+  "1661249912.556;5.4"
+  "1661249927.643;23.6"
+  "1661249942.701;23.6"

Renaissance/exp_results/db-shootout/ITR-0/cnettransmitbytes-measure-3.json

@@ -0,0 +1,5 @@
+  "1661249943.445;23.6"
+  "1661249958.55;4.8"
+  "1661249973.709;4.8"
+  "1661249988.83;13.533333333333333"
+  "1661250003.911;13.533333333333333"

Renaissance/exp_results/db-shootout/ITR-0/cnettransmitbytes-measure-4.json

@@ -0,0 +1,5 @@
+  "1661250004.456;13.533333333333333"
+  "1661250019.503;12.166666666666668"
+  "1661250034.596;12.166666666666666"
+  "1661250049.654;15.7"
+  "1661250064.696;15.7"

Renaissance/exp_results/db-shootout/ITR-0/cnettransmitbytes-warmup-0.json

@@ -0,0 +1,5 @@
+  "1661249454.855;1.5333333333333334"
+  "1661249469.998;4.166666666666667"
+  "1661249485.154;4.166666666666667"
+  "1661249500.34;7.1"
+  "1661249515.479;7.1"

Renaissance/exp_results/db-shootout/ITR-0/cnettransmitbytes-warmup-1.json

@@ -0,0 +1,5 @@
+  "1661249515.951;7.1"
+  "1661249531.096;12.466666666666667"
+  "1661249546.223;12.466666666666667"
+  "1661249561.356;6.8"
+  "1661249576.471;6.8"

Renaissance/exp_results/db-shootout/ITR-0/cnettransmitbytes-warmup-2.json

@@ -0,0 +1,5 @@
+  "1661249576.978;6.8"
+  "1661249592.009;15.16666666666667"
+  "1661249607.149;15.166666666666666"
+  "1661249622.196;7.166666666666667"
+  "1661249637.256;7.166666666666667"

Renaissance/exp_results/db-shootout/ITR-0/cnettransmitbytes-warmup-3.json

@@ -0,0 +1,5 @@
+  "1661249638.135;7.166666666666667"
+  "1661249653.279;13.466666666666667"
+  "1661249668.448;13.466666666666667"
+  "1661249683.681;8.3"
+  "1661249698.821;8.3"

Renaissance/exp_results/db-shootout/ITR-0/cnettransmitbytes-warmup-4.json

@@ -0,0 +1,5 @@
+  "1661249699.215;8.3"
+  "1661249714.322;14.133333333333333"
+  "1661249729.403;14.133333333333333"
+  "1661249744.471;11.3"
+  "1661249759.547;11.3"

Renaissance/exp_results/db-shootout/ITR-0/cpu-measure-0.json

@@ -0,0 +1,5 @@
+1661249760.181;1.672124460774074",
+1661249775.209;1.6593802866962966",
+1661249790.273;1.6593802866962966",
+1661249805.331;1.7243195954296295",
+1661249820.381;1.7243195954296295"

Renaissance/exp_results/db-shootout/ITR-0/cpu-measure-1.json

@@ -0,0 +1,5 @@
+1661249821.325;1.7243195954296295",
+1661249836.463;1.6574006516518518",
+1661249851.597;1.6574006516518518",
+1661249866.715;1.6976633891629633",
+1661249881.813;1.697663389162963",

Renaissance/exp_results/db-shootout/ITR-0/cpu-measure-2.json

@@ -0,0 +1,5 @@
+1661249882.389;1.697663389162963",
+1661249897.543;1.738135627566667",
+1661249912.678;1.738135627566667",
+1661249927.798;1.690606070811111",
+1661249942.842;1.690606070811111"

Renaissance/exp_results/db-shootout/ITR-0/cpu-measure-3.json

@@ -0,0 +1,5 @@
+1661249943.429;1.690606070811111",
+1661249958.492;1.5949291139851853",
+1661249973.623;1.5949291139851853",
+1661249988.823;1.6422275768407408",
+1661250003.919;1.6422275768407408",

Renaissance/exp_results/db-shootout/ITR-0/cpu-measure-4.json

@@ -0,0 +1,5 @@
+1661250004.424;1.6422275768407408",
+1661250019.628;1.6970871451074077",
+1661250034.704;1.6970871451074077",
+1661250049.769;1.6823183431222224",
+1661250064.795;1.6823183431222224",

Renaissance/exp_results/db-shootout/ITR-0/cpu-warmup-0.json

@@ -0,0 +1,9 @@
+1661249454.882;0.8336983513220041",
+1661249470.016;0.7844066080555597",
+1661249470.016;0.34305466253703515",
+1661249485.167;0.7309005818411053",
+1661249485.167;0.43569089924402393",
+1661249500.339;0.68553442292932",
+1661249500.339;0.508777989556723",
+1661249515.457;0.5965059359495362",
+1661249515.457;0.6314974695168104",

Renaissance/exp_results/db-shootout/ITR-0/cpu-warmup-1.json

@@ -0,0 +1,10 @@
+1661249515.923;0.5992100782315212",
+1661249515.923;0.6298318245710351",
+1661249531.095;0.6639514332417179",
+1661249531.095;0.5861999562467426",
+1661249546.231;0.7480305669348806",
+1661249546.231;0.5311025405115346",
+1661249561.353;0.467847619439281",
+1661249561.353;0.8612524796623994",
+1661249576.437;0.41388625338187024",
+1661249576.437;0.9485909723958635",

Renaissance/exp_results/db-shootout/ITR-0/cpu-warmup-2.json

@@ -0,0 +1,10 @@
+1661249577.027;0.9520071558162256",
+1661249577.027;0.4117755926835229"
+1661249592.117;1.0231483940445458",
+1661249592.117;0.36918171643328007",
+1661249607.299;0.31314067419550395",
+1661249607.299;1.1094642689940721",
+1661249622.329;1.1266314974248088",
+1661249622.329;0.2825365084892669",
+1661249637.425;1.2068923420595974",
+1661249637.425;0.22143353107921332",

Renaissance/exp_results/db-shootout/ITR-0/cpu-warmup-3.json

@@ -0,0 +1,6 @@
+1661249638.123;0.21860828742313107",
+1661249638.123;1.2106033959516933",
+1661249653.261;1.3891683934296488",
+1661249668.413;1.4766030566062427",
+1661249683.633;1.5476808018974932",
+1661249698.807;1.6342113693648406",

Renaissance/exp_results/db-shootout/ITR-0/cpu-warmup-4.json

@@ -0,0 +1,5 @@
+1661249699.191;1.63640115043163",
+1661249714.314;1.704009879374074",
+1661249729.416;1.704009879374074",
+1661249744.515;1.672124460774074",
+1661249759.601;1.672124460774074",

Renaissance/exp_results/db-shootout/ITR-0/diskdetails-measure-0.json

@@ -0,0 +1,5 @@
+  "1661249760.227;1140148633.6"
+  "1661249775.385;0"
+  "1661249790.49;0"
+  "1661249805.595;0"
+  "1661249820.706;0"

Renaissance/exp_results/db-shootout/ITR-0/diskdetails-measure-1.json

@@ -0,0 +1,5 @@
+  "1661249821.318;0"
+  "1661249836.463;1365.3333333333333"
+  "1661249851.578;1365.3333333333333"
+  "1661249866.702;1140148633.6"
+  "1661249881.76;1140148633.6"

Renaissance/exp_results/db-shootout/ITR-0/diskdetails-measure-2.json

@@ -0,0 +1,5 @@
+  "1661249882.392;1140148633.6"
+  "1661249897.543;6007.466666666666"
+  "1661249912.655;6007.466666666666"
+  "1661249927.682;3276.8"
+  "1661249942.771;3276.8"

Renaissance/exp_results/db-shootout/ITR-0/diskdetails-measure-3.json

@@ -0,0 +1,5 @@
+  "1661249943.455;3276.8"
+  "1661249958.572;1365.3333333333333"
+  "1661249973.7;1365.3333333333333"
+  "1661249988.834;1365.3333333333333"
+  "1661250003.918;1365.3333333333333"

Renaissance/exp_results/db-shootout/ITR-0/diskdetails-measure-4.json

@@ -0,0 +1,5 @@
+  "1661250004.471;1365.3333333333333"
+  "1661250019.63;1140157917.8666666"
+  "1661250034.702;1140157917.8666666"
+  "1661250049.788;26633830.4"
+  "1661250064.813;26633830.4"

Renaissance/exp_results/db-shootout/ITR-0/diskdetails-warmup-0.json

@@ -0,0 +1,5 @@
+  "1661249454.876;1140106854.4"
+  "1661249470.021;1140096204.8000002"
+  "1661249485.161;1140096204.8"
+  "1661249500.311;350754.13333333336"
+  "1661249515.463;350754.13333333336"

Renaissance/exp_results/db-shootout/ITR-0/diskdetails-warmup-1.json

@@ -0,0 +1,5 @@
+  "1661249515.945;350754.13333333336"
+  "1661249531.098;1140095931.7333333"
+  "1661249546.232;1140095931.7333333"
+  "1661249561.356;3276.8"
+  "1661249576.438;3276.8"

Renaissance/exp_results/db-shootout/ITR-0/diskdetails-warmup-2.json

@@ -0,0 +1,5 @@
+  "1661249577.012;3276.8"
+  "1661249592.107;1140376644.2666667"
+  "1661249607.281;1140376644.2666667"
+  "1661249622.305;1911.4666666666667"
+  "1661249637.389;1911.4666666666667"

Renaissance/exp_results/db-shootout/ITR-0/diskdetails-warmup-3.json

@@ -0,0 +1,5 @@
+  "1661249638.123;1911.4666666666667"
+  "1661249653.258;1140096750.9333332"
+  "1661249668.444;1140096750.9333334"
+  "1661249683.656;7099.733333333334"
+  "1661249698.793;7099.733333333334"

Renaissance/exp_results/db-shootout/ITR-0/diskdetails-warmup-4.json

@@ -0,0 +1,5 @@
+  "1661249699.13;7099.733333333334"
+  "1661249714.189;54067.2"
+  "1661249729.261;54067.2"
+  "1661249744.377;1140148633.6"
+  "1661249759.417;1140148633.6"

Renaissance/exp_results/db-shootout/ITR-0/fsiototal-measure-0.json

@@ -0,0 +1,5 @@
+  "1661249760.222;0.000000009166666666666438"
+  "1661249775.385;0.000000008433333333333303"
+  "1661249790.468;0.000000008433333333333303"
+  "1661249805.577;0.00000001306666666666731"
+  "1661249820.713;0.00000001306666666666731"

Renaissance/exp_results/db-shootout/ITR-0/fsiototal-measure-1.json

@@ -0,0 +1,5 @@
+  "1661249821.305;0.00000001306666666666731"
+  "1661249836.438;0.000000009166666666666438"
+  "1661249851.589;0.000000009166666666666438"
+  "1661249866.63;0.000000012633333333333476"
+  "1661249881.786;0.000000012633333333333478"

Renaissance/exp_results/db-shootout/ITR-0/fsiototal-measure-2.json

@@ -0,0 +1,5 @@
+  "1661249882.366;0.000000012633333333333478"
+  "1661249897.525;0.000000008799999999999419"
+  "1661249912.643;0.000000008799999999999419"
+  "1661249927.666;0.000000014233333333333371"
+  "1661249942.738;0.000000014233333333333371"

Renaissance/exp_results/db-shootout/ITR-0/fsiototal-measure-3.json

@@ -0,0 +1,5 @@
+  "1661249943.425;0.000000014233333333333371"
+  "1661249958.481;0.000000008566666666666929"
+  "1661249973.543;0.000000008566666666666929"
+  "1661249988.616;0.00000000753333333333359"
+  "1661250003.667;0.00000000753333333333359"

Renaissance/exp_results/db-shootout/ITR-0/fsiototal-measure-4.json

@@ -0,0 +1,5 @@
+  "1661250004.494;0.00000000753333333333359"
+  "1661250019.523;0.000000012499999999999852"
+  "1661250034.635;0.000000012499999999999852"
+  "1661250049.683;0.00000001183333333333353"
+  "1661250064.731;0.00000001183333333333353"

Renaissance/exp_results/db-shootout/ITR-0/fsiototal-warmup-0.json

@@ -0,0 +1,5 @@
+  "1661249454.855;0.000000018333333333332875"
+  "1661249470.013;0.000000013766666666666586"
+  "1661249485.167;0.000000013766666666666586"
+  "1661249500.349;0.000000007233333333333382"
+  "1661249515.472;0.000000007233333333333382"

Renaissance/exp_results/db-shootout/ITR-0/fsiototal-warmup-1.json

@@ -0,0 +1,5 @@
+  "1661249515.951;0.000000007233333333333382"
+  "1661249531.089;0.000000013433333333333425"
+  "1661249546.213;0.000000013433333333333425"
+  "1661249561.334;0.000000008233333333333768"
+  "1661249576.453;0.000000008233333333333768"

Renaissance/exp_results/db-shootout/ITR-0/fsiototal-warmup-2.json

@@ -0,0 +1,5 @@
+  "1661249576.999;0.000000008233333333333768"
+  "1661249592.11;0.00000001200000000000011"
+  "1661249607.381;0.00000001200000000000011"
+  "1661249622.438;0.000000008266666666666722"
+  "1661249637.605;0.000000008266666666666722"

Renaissance/exp_results/db-shootout/ITR-0/fsiototal-warmup-3.json

@@ -0,0 +1,5 @@
+  "1661249638.132;0.000000008266666666666722"
+  "1661249653.274;0.000000012933333333332784"
+  "1661249668.392;0.00000001293333333333278"
+  "1661249683.672;0.00000000819999999999991"
+  "1661249698.81;0.00000000819999999999991"

Renaissance/exp_results/db-shootout/ITR-0/fsiototal-warmup-4.json

@@ -0,0 +1,5 @@
+  "1661249699.205;0.00000000819999999999991"
+  "1661249714.314;0.00000001183333333333353"
+  "1661249729.382;0.00000001183333333333353"
+  "1661249744.449;0.000000009166666666666438"
+  "1661249759.509;0.000000009166666666666438"

Renaissance/exp_results/db-shootout/ITR-0/fsreadtotal-measure-0.json

@@ -0,0 +1,5 @@
+  "1661249760.22;0"
+  "1661249775.335;0"
+  "1661249790.356;0"
+  "1661249805.437;0"
+  "1661249820.485;0"

Renaissance/exp_results/db-shootout/ITR-0/fsreadtotal-measure-1.json

@@ -0,0 +1,5 @@
+  "1661249821.312;0"
+  "1661249836.447;0"
+  "1661249851.523;0"
+  "1661249866.581;0"
+  "1661249881.704;0"

Renaissance/exp_results/db-shootout/ITR-0/fsreadtotal-measure-2.json

@@ -0,0 +1,5 @@
+  "1661249882.389;0"
+  "1661249897.529;0"
+  "1661249912.681;0"
+  "1661249927.796;0"
+  "1661249942.924;0"

Renaissance/exp_results/db-shootout/ITR-0/fsreadtotal-measure-3.json

@@ -0,0 +1,5 @@
+  "1661249943.417;0"
+  "1661249958.445;0"
+  "1661249973.549;0"
+  "1661249988.6;0"
+  "1661250003.648;0"

Renaissance/exp_results/db-shootout/ITR-0/fsreadtotal-measure-4.json

@@ -0,0 +1,5 @@
+  "1661250004.482;0"
+  "1661250019.55;0"
+  "1661250034.633;0"
+  "1661250049.682;0"
+  "1661250064.734;0"