new experiment and results

Gapminder · Dec 6, 2024 · 4d79f6d · 4d79f6d
1 parent ed4aa13
commit 4d79f6d
Show file tree

Hide file tree

Showing 14 changed files with 9,949 additions and 0 deletions.
diff --git a/...t_202412052345_fireworks_ai_accounts_fireworks_models_llama-v3p1-405b-instruct_en-US.yaml b/...t_202412052345_fireworks_ai_accounts_fireworks_models_llama-v3p1-405b-instruct_en-US.yaml
diff --git a/...xperiments/experiment_configurations/experiment_202412052345_gpt-4o-2024-08-06_en-US.yaml b/...xperiments/experiment_configurations/experiment_202412052345_gpt-4o-2024-08-06_en-US.yaml
diff --git a/...nt_configurations/experiment_202412052345_vertex_ai_claude-3-5-sonnet@20240620_en-US.yaml b/...nt_configurations/experiment_202412052345_vertex_ai_claude-3-5-sonnet@20240620_en-US.yaml
diff --git a/...eriments/experiment_configurations/experiment_202412060713_qwen-max-2024-09-19_en-US.yaml b/...eriments/experiment_configurations/experiment_202412060713_qwen-max-2024-09-19_en-US.yaml
diff --git a/...experiment_configurations/experiment_202412061047_vertex_ai_gemini-1-5-pro-002_en-US.yaml b/...experiment_configurations/experiment_202412061047_vertex_ai_gemini-1-5-pro-002_en-US.yaml
diff --git a/...al_experiments/experiment_configurations/experiment_202412061914_xai_grok-beta_en-US.yaml b/...al_experiments/experiment_configurations/experiment_202412061914_xai_grok-beta_en-US.yaml
diff --git a/automation-api/yival_experiments/output/20241205/README b/automation-api/yival_experiments/output/20241205/README
@@ -0,0 +1,7 @@
+# About
+
+This experiment filled the missing datapoints for a few questions, which we want to see all chatbots' results.
+
+There are 12 questions and 6 models in total, some of them are already tested in previous experiments.
+
+Because gemini 0409 is old, we did not use previous experiment result but used latest gemini-pro-002 for testing all 12 questions.
diff --git a/..._202412052345_fireworks_ai_accounts_fireworks_models_llama-v3p1-405b-instruct_en-US_0.pkl b/..._202412052345_fireworks_ai_accounts_fireworks_models_llama-v3p1-405b-instruct_en-US_0.pkl
diff --git a/...i/yival_experiments/output/20241205/experiment_202412052345_gpt-4o-2024-08-06_en-US_0.pkl b/...i/yival_experiments/output/20241205/experiment_202412052345_gpt-4o-2024-08-06_en-US_0.pkl
diff --git a/.../output/20241205/experiment_202412052345_vertex_ai_claude-3-5-sonnet@20240620_en-US_0.pkl b/.../output/20241205/experiment_202412052345_vertex_ai_claude-3-5-sonnet@20240620_en-US_0.pkl
diff --git a/...yival_experiments/output/20241205/experiment_202412060713_qwen-max-2024-09-19_en-US_0.pkl b/...yival_experiments/output/20241205/experiment_202412060713_qwen-max-2024-09-19_en-US_0.pkl
diff --git a/...eriments/output/20241205/experiment_202412061047_vertex_ai_gemini-1-5-pro-002_en-US_0.pkl b/...eriments/output/20241205/experiment_202412061047_vertex_ai_gemini-1-5-pro-002_en-US_0.pkl
diff --git a/...n-api/yival_experiments/output/20241205/experiment_202412061914_xai_grok-beta_en-US_0.pkl b/...n-api/yival_experiments/output/20241205/experiment_202412061914_xai_grok-beta_en-US_0.pkl
diff --git a/automation-api/yival_experiments/output/20241205/results.xlsx b/automation-api/yival_experiments/output/20241205/results.xlsx