Skip to content

Latest commit

 

History

History
232 lines (213 loc) · 28.2 KB

04-final-standings.md

File metadata and controls

232 lines (213 loc) · 28.2 KB

Previous post

See also the Russian version of this post.

Final Standings

After a lot of testing, we are now releasing the final standings, as well as publishing the names or pseudonyms of each solution's author.

Thanks to all who participated, and congratulations to the winners!

The 400 USD special prize goes to someone under the pseudonym indutny for developing an alternative online testing arena that allowed for faster testing of different solutions against each other than the one we provided. Thank you for your involvement!

Statistics

We tested the 50 finalists on 500 additional seeds. We also took into account all the sessions that the finalists already had among themselves during the first round (on 500 seeds), but not the sessions finalists had with solutions that didn't make it into the finals. In total, the ranking of the finalists was determined by 1000 sessions for every ordered pair of distinct solutions. For 50 finalists, 2,450 sessions per seed were run, for a total of 2,450,000 sessions. Each solution was tested in 98,000 sessions.

2,358,913 sessions (96.28%) resulted in an agreement. The average payout was 7.0275 per session, or 7.2989 per agreement. It is, in fact, impressive how the top 50 solutions are really good at using almost every opportunity to make a deal.

1,272 sessions (0.05%) were aborted for various reasons (invalid offers, exceptions).

Raw logs

The full logs of all 2,450,000 sessions of the finals are published as an archive (322 MB). A session's log is stored in the archive as S/A-B.json, where S is the seed, A is the solution ID of the first participant, and B is the solution ID of the second participant.

You can use haggle.js --replay=LOG.json to “replay” a session log as human-readable text.

It will be interesting to see some creative analysis of the raw logs for the finals and for round 1 by the community.

Scores

Legend:

  • S: Total score (this is what the competition is about)
  • S/N: Average score per session
  • A: Number of sessions where an agreement has been reached
  • A/N: Number of agreements as a percentage of the number of sessions
  • S/A: Average score per session where an agreement has been reached
  • X: Number of sessions aborted by the solution (exceptions, incorrect output)
# ID S S/N A A/N S/A X
1 Asta 744277 7.5947 94775 96.71% 7.85 0
2 Silent Bob 741761 7.5690 95064 97.00% 7.80 0
3 Robert Speed 728167 7.4303 93764 95.68% 7.77 0
4 freewayrider 723938 7.3871 95729 97.68% 7.56 0
5 Alexander Bykov 718609 7.3327 93189 95.09% 7.71 0
6 Sergey Garkavenko 711331 7.2585 92582 94.47% 7.68 0
7 Serzh 710151 7.2464 95936 97.89% 7.40 0
8 Wagok 709165 7.2364 92997 94.89% 7.63 0
9 Lebedev Andrey Nikolayevich 707909 7.2236 94363 96.29% 7.50 0
10 StaP 707355 7.2179 93069 94.97% 7.60 0
11 Yuri Sergeevich Cherezov 706741 7.2116 95029 96.97% 7.44 0
12 DenAlex 706171 7.2058 93179 95.08% 7.58 0
13 J.K. 704943 7.1933 94475 96.40% 7.46 0
14 Kazakoff 703183 7.1753 95189 97.13% 7.39 0
15 BPC 699526 7.1380 90812 92.67% 7.70 0
16 Anton Zakharov 699031 7.1330 95966 97.92% 7.28 0
17 Andrey Morozov 698189 7.1244 96142 98.10% 7.26 0
18 nick0 698037 7.1228 95685 97.64% 7.30 0
19 Nomad1 697574 7.1181 93533 95.44% 7.46 0
20 Ustilov Artem Olexandrovych 695109 7.0929 94123 96.04% 7.39 0
21 unk 695037 7.0922 92006 93.88% 7.55 0
22 RJA 693136 7.0728 96593 98.56% 7.18 0
23 Victoria Manukyan 692160 7.0629 94359 96.28% 7.34 0
24 Nicolas Letellier 691456 7.0557 94455 96.38% 7.32 0
25 Chrysanthi Papamichail 689757 7.0383 92063 93.94% 7.49 0
26 Koba Bogdan Georgievich 688869 7.0293 92829 94.72% 7.42 0
27 Vladimir Kuriatkov 687768 7.0180 96228 98.19% 7.15 0
28 Mihai Chirculescu 685800 6.9980 94685 96.62% 7.24 0
29 Batman 685357 6.9934 94568 96.50% 7.25 0
30 Andrew Chuhlomin 683142 6.9708 93799 95.71% 7.28 0
31 razza 683112 6.9705 95238 97.18% 7.17 0
32 Casanunda 680881 6.9478 96165 98.13% 7.08 1101
33 aid 677736 6.9157 92245 94.13% 7.35 0
34 Dmitriy Nalivaiko 677696 6.9153 92211 94.09% 7.35 0
35 Davide Baldini 676475 6.9028 94482 96.41% 7.16 0
36 DRY team variantB 676052 6.8985 90351 92.19% 7.48 0
37 Sergey Avilov 674698 6.8847 93881 95.80% 7.19 0
38 avmfree 670108 6.8378 90146 91.99% 7.43 0
39 sav31 669993 6.8367 93811 95.73% 7.14 0
40 Georgi Olentsenko 667556 6.8118 96381 98.35% 6.93 0
41 Viktor 665611 6.7919 96861 98.84% 6.87 0
42 Andrew Ivannikov 664778 6.7834 96970 98.95% 6.86 0
43 Konstantin Barkalov 664552 6.7811 92833 94.73% 7.16 0
44 Evgeny Morozov 663730 6.7728 95898 97.86% 6.92 0
45 Eugene Churmanov 663318 6.7686 96871 98.85% 6.85 0
46 Chechushkov Yuri 661625 6.7513 96969 98.95% 6.82 0
47 WWWWWWWWW 654058 6.6741 96362 98.33% 6.79 171
48 dfgdfgjdfkjgd 651404 6.6470 93003 94.90% 7.00 0
49 Danylo Yakymenko 650366 6.6364 93531 95.44% 6.95 0
50 Alexey Kolpakov 637580 6.5059 96431 98.40% 6.61 0

The standings below the top 50 are as already determined by round 1. We are repeating that part of the table here, this time with the participants' names. The S and A columns below are not comparable with those in the table above because the number of sessions is different.

# ID S S/N A A/N S/A X
51 Memo 1177398 6.3643 152701 82.54% 7.71 0
52 stopslt 1177345 6.3640 172260 93.11% 6.83 0
53 Sergey Talov 1175879 6.3561 156326 84.50% 7.52 0
54 Victor Vashchenko 1175500 6.3541 167153 90.35% 7.03 5
55 the_random 1174931 6.3510 165356 89.38% 7.11 0
56 maurya777 1174282 6.3475 169619 91.69% 6.92 0
57 CyberZhuk 1173430 6.3429 161429 87.26% 7.27 0
58 EMMANOUIL VACHLAS 1172056 6.3354 159060 85.98% 7.37 0
59 Kirov Vadim Viktorovich 1172051 6.3354 169435 91.59% 6.92 0
60 Viktor Morozov 1171860 6.3344 169417 91.58% 6.92 0
61 elgogouv 1171148 6.3305 158764 85.82% 7.38 0
62 delkappa 1171071 6.3301 151128 81.69% 7.75 0
63 Mad@ 1169587 6.3221 159406 86.17% 7.34 0
64 Andrey Generalyuk 1168919 6.3185 159294 86.10% 7.34 0
65 alph 1168882 6.3183 153660 83.06% 7.61 17
66 Yellow Horror 1168491 6.3162 174827 94.50% 6.68 0
67 Leonov Alexandr 1167646 6.3116 153285 82.86% 7.62 0
68 ORKI_NA_GORKE 1167609 6.3114 158502 85.68% 7.37 0
69 musically_ut 1165335 6.2991 153299 82.86% 7.60 0
70 Dizarab 1164697 6.2957 162387 87.78% 7.17 0
71 PavelK 1162737 6.2851 152222 82.28% 7.64 0
72 NotThisTime 1161902 6.2806 158772 85.82% 7.32 0
73 rrr111 1161529 6.2785 167699 90.65% 6.93 0
74 reaqtorb 1160215 6.2714 161206 87.14% 7.20 0
75 CR1MS0N 1159033 6.2650 173637 93.86% 6.68 0
76 arseniy_t 1158476 6.2620 174139 94.13% 6.65 0
77 Zavtramen 1158424 6.2618 160602 86.81% 7.21 0
78 CWN 1157288 6.2556 152569 82.47% 7.59 0
79 indutny 1156074 6.2490 166383 89.94% 6.95 0
80 SAGAK 1156044 6.2489 168411 91.03% 6.86 0
81 Jacek Mańkowski 1154194 6.2389 145050 78.41% 7.96 0
82 Mikhail Commandant 1152820 6.2315 158599 85.73% 7.27 0
83 Vladislav Zaytsev 1148881 6.2102 159210 86.06% 7.22 0
84 Gromo 1148472 6.2080 162252 87.70% 7.08 0
85 tunakilawin 1148350 6.2073 152330 82.34% 7.54 0
86 alvvi 1147845 6.2046 167767 90.68% 6.84 0
87 nateebaz 1145924 6.1942 157670 85.23% 7.27 0
88 Alex Molas Martin 1144334 6.1856 160030 86.50% 7.15 0
89 gnilly 1144157 6.1846 146680 79.29% 7.80 16
90 Andrew Ilin 1143273 6.1799 170092 91.94% 6.72 0
91 noCoCu_TbI_mou_guBaH 1139958 6.1619 160199 86.59% 7.12 0
92 Ivan Gladkov 1139859 6.1614 154886 83.72% 7.36 0
93 Lod Lawson-betum 1136690 6.1443 142316 76.93% 7.99 0
94 Aggelos Papamichail 1136008 6.1406 152490 82.43% 7.45 122
95 Jakub M 1135678 6.1388 138134 74.67% 8.22 0
96 vsevolod86 1134302 6.1314 157296 85.02% 7.21 0
97 Oleg Nosov 1133800 6.1286 169210 91.46% 6.70 0
98 Artem Reshetov 1132839 6.1235 160600 86.81% 7.05 0
99 Valerii Petlia 1131947 6.1186 138402 74.81% 8.18 0
100 Vladimir Valov 1130084 6.1086 141971 76.74% 7.96 0
101 Pavel Goltsev 1129117 6.1033 143072 77.34% 7.89 0
102 Wertolet 1128923 6.1023 138257 74.73% 8.17 0
103 Aksana Mashyr 1125786 6.0853 153657 83.06% 7.33 0
104 sirgeika 1125722 6.0850 144804 78.27% 7.77 0
105 steve3003 1125451 6.0835 153232 82.83% 7.34 0
106 Andres Kovalev 1125027 6.0812 176607 95.46% 6.37 0
107 Oleg Vorobyov 1124888 6.0805 176175 95.23% 6.39 0
108 Mikhail Stepanov 1124228 6.0769 148565 80.31% 7.57 0
109 ShadowMach 1124011 6.0757 149386 80.75% 7.52 0
110 Anzo Zhao Yang Teh 1122985 6.0702 181532 98.13% 6.19 0
111 YKYWY 1122402 6.0670 143796 77.73% 7.81 0
112 Oliver Holmström 1120801 6.0584 162029 87.58% 6.92 0
113 Alexey Novikov 1119910 6.0536 144932 78.34% 7.73 0
114 Eiskalter 1119589 6.0518 160207 86.60% 6.99 0
115 jan.thphysics 1115764 6.0312 150246 81.21% 7.43 0
116 IFG 1115717 6.0309 147281 79.61% 7.58 0
117 Aleksandr Madzhugin 1115071 6.0274 174592 94.37% 6.39 0
118 max powers 1113934 6.0213 146593 79.24% 7.60 0
119 pynur 1112158 6.0117 136831 73.96% 8.13 0
120 Anton Solovyov 1112061 6.0111 136434 73.75% 8.15 0
121 piggy peppa 1111146 6.0062 170454 92.14% 6.52 0
122 Alexander Levakov 1108742 5.9932 155886 84.26% 7.11 0
123 andydspl 1107358 5.9857 155870 84.25% 7.10 1446
124 JohnDoe 1106655 5.9819 152046 82.19% 7.28 0
125 Alexandros Kontarinis 1102864 5.9614 141448 76.46% 7.80 0
126 Andrey Mikhaylenko 1101407 5.9536 154763 83.66% 7.12 34
127 Linih Rimira 1098566 5.9382 149625 80.88% 7.34 0
128 Kat 1097870 5.9344 137883 74.53% 7.96 0
129 Bykov Vladislav Andreevich 1095701 5.9227 153262 82.84% 7.15 0
130 Alexey Nesterenko 1093110 5.9087 173814 93.95% 6.29 0
131 IvajG 1091374 5.8993 126675 68.47% 8.62 0
132 Lightkeeper217 1085887 5.8697 152689 82.53% 7.11 8488
133 taluks 1084489 5.8621 178883 96.69% 6.06 0
134 Patrik Segedy 1082286 5.8502 140595 76.00% 7.70 0
135 F_S 1079983 5.8377 164047 88.67% 6.58 0
136 Torrion 1078046 5.8273 139978 75.66% 7.70 0
137 TonyBoyc87 1074088 5.8059 137436 74.29% 7.82 0
138 ds 1073602 5.8033 132592 71.67% 8.10 0
139 anna 1071717 5.7931 144122 77.90% 7.44 0
140 Dionysios Kontarinis 1068352 5.7749 135775 73.39% 7.87 0
141 Stephen Young 1067409 5.7698 141710 76.60% 7.53 0
142 Denis Olshin 1063341 5.7478 140598 76.00% 7.56 0
143 SBars 1062601 5.7438 129435 69.96% 8.21 0
144 Alexander Volkov 1054358 5.6992 129245 69.86% 8.16 0
145 Volodymyr Synytskyi 1045647 5.6521 138340 74.78% 7.56 0
146 poisonbox 1045429 5.6510 132729 71.75% 7.88 0
147 i_really_like_cookies 1045086 5.6491 148990 80.54% 7.01 0
148 Todo 1044890 5.6481 124719 67.42% 8.38 0
149 Oleksandr Ustilov 1044541 5.6462 137603 74.38% 7.59 0
150 V-Big 1043975 5.6431 172455 93.22% 6.05 0
151 Ivan Zakharov 1043214 5.6390 125105 67.62% 8.34 0
152 Ildar Gaziev 1040107 5.6222 172006 92.98% 6.05 0
153 bazil 1039128 5.6169 132073 71.39% 7.87 0
154 ns5d 1035270 5.5961 136774 73.93% 7.57 0
155 Ofir Zeitoun 1018337 5.5045 181812 98.28% 5.60 0
156 vinchik91 1006254 5.4392 119932 64.83% 8.39 0
157 Pablo Green 990692 5.3551 163090 88.16% 6.07 0
158 ivan sedletzki 985762 5.3284 139369 75.33% 7.07 0
159 Guardian 984195 5.3200 181472 98.09% 5.42 0
160 Sergey Okhrymenko 981510 5.3055 129531 70.02% 7.58 0
161 Moldovan Andrei 977419 5.2833 122326 66.12% 7.99 0
162 Blake Allison 959900 5.1886 116630 63.04% 8.23 0
163 fo0 959515 5.1866 106831 57.75% 8.98 364
164 anton 953917 5.1563 153238 82.83% 6.23 8
165 vanntile 953713 5.1552 176549 95.43% 5.40 0
166 fzv 948100 5.1249 165353 89.38% 5.73 0
167 fox73 939662 5.0793 108042 58.40% 8.70 0
168 VariableVasas 930869 5.0317 137444 74.29% 6.77 2462
169 Carlos Abraham Hernandez 921645 4.9819 158768 85.82% 5.80 0
170 Tyiler 920335 4.9748 160984 87.02% 5.72 6033
171 jack 905546 4.8948 102427 55.37% 8.84 0
172 CatWithoutBoots 901665 4.8739 99526 53.80% 9.06 0
173 74nk 848228 4.5850 93249 50.40% 9.10 0
174 Kalievskiy Yan 840401 4.5427 127536 68.94% 6.59 8321
175 zero0x0 836861 4.5236 94376 51.01% 8.87 0
176 Jonathan Share 833259 4.5041 86866 46.95% 9.59 0
177 Yuri Homyakov 818451 4.4241 129428 69.96% 6.32 0
178 Kyler A Berry 791037 4.2759 82345 44.51% 9.61 0
179 Vladimir Zaiko 746529 4.0353 100860 54.52% 7.40 59432
180 James Wright 720138 3.8926 153560 83.01% 4.69 0
181 Pavel Sokolov 639048 3.4543 139696 75.51% 4.57 0
182 CyberGorynych 503494 2.7216 56723 30.66% 8.88 0
183 VOLK 326159 1.7630 38342 20.73% 8.51 0
184 l4hg 113192 0.6118 13185 7.13% 8.58 170626
185 Arthur Reshetnikov 35169 0.1901 3612 1.95% 9.74 180128
186 k0nagaya 0 0.0000 0 0.00% n/a 184374