Skip to content

Commit

Permalink
ENH: Switch to style-control rankings
Browse files Browse the repository at this point in the history
  • Loading branch information
@sanand0
sanand0 committed Nov 24, 2024
1 parent 5242a91 commit 4218b82
Show file tree
Hide file tree
Showing 2 changed files with 161 additions and 161 deletions.
4 changes: 2 additions & 2 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ These are shown in green 🟢 and are the best LLMs to use.
Some LLMs are "pareto suboptimal", i.e. there is no LLM worse in both cost and quality.
These are shown in red 🔴 and are the LLMs to avoid.

Last updated: **22 Nov 2024**
Last updated: **24 Nov 2024**

Alternatives: [ArtificialAnalysis.ai](https://artificialanalysis.ai/)

Expand All @@ -32,6 +32,6 @@ Alternatives: [ArtificialAnalysis.ai](https://artificialanalysis.ai/)
- Copy the JSON from the event stream at `data?session_hash=...`
- Format the data: event stream as JSON in VS Code
- Extract the "data": array of arrays as a table via https://tools.s-anand.net/json2csv/
- Update `elo.csv` via lookups
- Update `elo.csv` via lookups with the STYLE CONTROLLED Elo scores
-->
318 changes: 159 additions & 159 deletions elo.csv
View file
Original file line number Diff line number Diff line change
@@ -1,161 +1,161 @@
model,overall,hard,coding,cpmi,launch,end,source
gemini-exp-1121,1365,1353,1290,,2024-11,,
gemini-exp-1114,1343,1332,1271,,2024-11,,
chatgpt-4o-latest-20240903,1339,1332,1339,5,2024-08,2024-11,https://openai.com/api/pricing/
chatgpt-4o-latest-20241120,1360,1332,1275,5,2024-11,,https://openai.com/api/pricing/
o1-preview,1333,1350,1305,15,2024-09,,https://openai.com/api/pricing/
o1-mini,1308,1341,1283,3,2024-09,,https://openai.com/api/pricing/
gemini-1.5-pro-002,1300,1298,1265,5,2024-10,,
grok-2-2024-08-13,1288,1275,1238,5,2024-09,,https://openrouter.ai/x-ai/grok-2
yi-lightning,1286,1299,1249,,2024-10,,
gpt-4o-2024-05-13,1284,1284,1251,2.5,2024-09,,
claude-3-5-sonnet-20241022,1282,1302,1298,3,2024-10,,
glm-4-plus,1273,1273,1230,0.33,2024-10,,https://open.bigmodel.cn/pricing
gpt-4o-mini-2024-07-18,1272,1267,1221,0.15,2024-07,,https://openai.com/api/pricing/
gemini-1.5-flash-002,1271,1255,1214,0.075,2024-10,,
llama-3.1-nemotron-70b-instruct,1268,1267,1224,0.35,2024-10,,https://openrouter.ai/nvidia/llama-3.1-nemotron-70b-instruct
claude-3-5-sonnet-20240620,1267,1279,1269,3,2024-06,,
llama-3.1-405b-instruct-fp8,1267,1266,1247,2.75,2024-07,,https://openrouter.ai/meta-llama/llama-3.1-405b-instruct
grok-2-mini-2024-08-13,1266,1260,1220,,2024-08,,
gemini-advanced-0514,1266,1253,1237,,2024-05,,
llama-3.1-405b-instruct-bf16,1265,1272,1253,2,2024-06,,https://openrouter.ai/models/meta-llama/llama-3.1-405b
yi-lightning-lite,1264,1271,1234,,2024-10,,
gpt-4o-2024-08-06,1264,1267,1237,2.5,2024-08,,https://openai.com/api/pricing/
qwen-max-0919,1263,1273,1232,,,,
gemini-1.5-pro-001,1259,1258,1237,3.5,2024-05,,https://ai.google.dev/pricing
qwen2.5-72b-instruct,1258,1268,1225,0.35,2024-09,,https://openrouter.ai/models/qwen/qwen-2.5-72b-instruct
deepseek-v2.5,1257,1273,1233,0.14,2024-08,,https://openrouter.ai/models/deepseek/deepseek-chat
gpt-4-turbo-2024-04-09,1256,1254,1226,10,2024-04,,https://openai.com/api/pricing/
mistral-large-2407,1251,1259,1231,2,2024-07,,https://openrouter.ai/models/mistralai/mistral-large
athene-70b-0725,1250,1247,1224,,2024-07,,
gpt-4-1106-preview,1249,1246,1226,10,2023-11,,https://openai.com/api/pricing/
claude-3-opus-20240229,1247,1245,1234,15,2024-02,,
llama-3.1-70b-instruct,1247,1242,1210,0.52,2024-06,,https://openrouter.ai/models/meta-llama/llama-3.1-70b-instruct
gpt-4-0125-preview,1244,1241,1218,10,2024-01,,https://openai.com/api/pricing/
yi-large-preview,1239,1239,1205,,2024-07,,
reka-core-20240722,1230,1205,1186,,2024-07,,
qwen-plus-0828,1227,1241,1207,,2024-08,,
gemini-1.5-flash-001,1226,1224,1200,0.075,2024-08,,https://ai.google.dev/pricing
jamba-1.5-large,1220,1219,1192,2,2024-08,,https://openrouter.ai/models/ai21/jamba-1-5-large
deepseek-v2-api-0628,1219,1233,1210,0.14,2024-06,,
gemma-2-27b-it,1219,1204,1192,0.27,2024-06,,https://openrouter.ai/models/google/gemma-2-27b-it
command-r-plus-08-2024,1214,1188,1171,,2024-08,,
gemma-2-9b-it-simpo,1215,1203,1185,,,,
deepseek-coder-v2-0724,1214,1235,1210,0.14,2024-07,,
yi-large,1212,1208,1185,3,2023-10,,https://openrouter.ai/models/01-ai/yi-large
gemini-1.5-flash-8b-001,1210,1209,1171,0.0375,2024-10,,
llama-3.1-nemotron-51b-instruct,1211,1207,1192,0.35,2024-10,,https://openrouter.ai/nvidia/llama-3.1-nemotron-70b-instruct
nemotron-4-340b-instruct,1209,1202,1188,4.2,2024-06,,https://openrouter.ai/models/nvidia/nemotron-4-340b-instruct
glm-4-0520,1206,1213,1188,0.66,2024-05,,https://open.bigmodel.cn/pricing
llama-3-70b-instruct,1206,1197,1187,0.59,2024-04,,https://openrouter.ai/models/meta-llama/llama-3-70b-instruct
gemini-1.5-flash-8b-exp-0827,1205,1195,1161,,,,
claude-3-sonnet-20240229,1200,1198,1190,3,2024-02,,
reka-flash-20240722,1200,1178,1164,,,,
reka-core-20240501,1199,1186,1167,,2024-05,,
gemma-2-9b-it,1190,1170,1160,0.2,2024-06,,https://openrouter.ai/models/google/gemma-2-9b-it
command-r-plus,1189,1168,1159,3,2024-01,,
hunyuan-standard-256k,1188,1218,1179,,,,
qwen2-72b-instruct,1187,1189,1178,0.34,2024-06,,https://openrouter.ai/qwen/qwen-2-72b-instruct
gpt-4-0314,1186,1195,1202,30,2024-03,,https://platform.openai.com/docs/deprecations/
glm-4-0116,1183,1186,1164,,2024-01,,
qwen-max-0428,1183,1186,1167,,2024-04,,
claude-3-haiku-20240307,1179,1178,1174,0.25,2024-03,,
command-r-08-2024,1179,1169,1164,,,,
ministral-8b-2410,1181,1196,1165,0.1,2024-10,,https://openrouter.ai/mistralai/ministral-8b
deepseek-coder-v2,1178,1210,1196,0.14,2024-07,,https://openrouter.ai/models/deepseek/deepseek-coder
jamba-1.5-mini,1176,1168,1145,0.2,2024-08,,https://openrouter.ai/models/ai21/jamba-1-5-mini
llama-3.1-8b-instruct,1175,1182,1141,0.06,2024-06,,https://openrouter.ai/models/meta-llama/llama-3.1-8b-instruct
reka-flash-preview-20240611,1165,1144,1136,,,,
gpt-4-0613,1163,1167,1181,30,2024-06,,https://platform.openai.com/docs/deprecations/
qwen1.5-110b-chat,1161,1168,1154,1.62,2024-04,,https://openrouter.ai/models/qwen/qwen-110b-chat
yi-1.5-34b-chat,1157,1159,1135,,2024-05,,
mistral-large-2402,1157,1165,1164,8,2023-11,,
reka-flash-21b-20240226-online,1155,1142,1143,,2024-02,,
llama-3-8b-instruct,1151,1137,1128,0.05,2024-04,,
internlm2_5-20b-chat,1149,1166,1141,,,,
claude-1,1148,1125,1135,8,2023-03,,
command-r,1148,1119,1122,0.5,2023-12,,
reka-flash-21b-20240226,1147,1133,1134,,2024-02,,
qwen1.5-72b-chat,1147,1146,1142,0.81,2024-01,,https://openrouter.ai/models/qwen/qwen-72b-chat
mistral-medium,1147,1144,1136,2.7,2023-11,,
mixtral-8x22b-instruct-v0.1,1147,1148,1146,0.7,2024-05,,
gemma-2-2b-it,1140,1114,1094,0.06,2024-06,,https://openrouter.ai/google/gemma-2-9b-it
gemini-pro-dev-api,1131,1105,1124,0.5,2024-01,,https://ai.google.dev/pricing
claude-2.0,1131,1126,1141,8,2023-07,,
zephyr-orpo-141b-A35b-v0.1,1126,1116,1119,,,,
qwen1.5-32b-chat,1125,1135,1131,0.72,2023-11,,https://openrouter.ai/models/qwen/qwen-32b-chat
mistral-next,1124,1128,1148,,,,
phi-3-medium-4k-instruct,1122,1129,1121,,,,https://openrouter.ai/microsoft/phi-3-medium-4k-instruct
starling-lm-7b-beta,1118,1119,1103,,2024-03,,
claude-2.1,1118,1118,1135,8,2023-11,,
gpt-3.5-turbo-0613,1116,1123,1134,1.5,2023-06,,https://openai.com/api/pricing/
gemini-exp-1121,1292,1288,1341,,2024-11,,
gemini-exp-1114,1268,1272,1325,,2024-11,,
chatgpt-4o-latest-20240903,1291,1277,1347,5,2024-08,2024-11,https://openai.com/api/pricing/
chatgpt-4o-latest-20241120,1311,1277,1347,5,2024-11,,https://openai.com/api/pricing/
o1-preview,1300,1306,1354,15,2024-09,,https://openai.com/api/pricing/
o1-mini,1258,1283,1364,3,2024-09,,https://openai.com/api/pricing/
gemini-1.5-pro-002,1266,1264,1288,5,2024-10,,
grok-2-2024-08-13,1248,1239,1285,5,2024-09,,https://openrouter.ai/x-ai/grok-2
yi-lightning,1244,1249,1302,,2024-10,,
gpt-4o-2024-05-13,1262,1251,1293,2.5,2024-09,,
claude-3-5-sonnet-20241022,1283,1298,1319,3,2024-10,,
glm-4-plus,1233,1230,1283,0.33,2024-10,,https://open.bigmodel.cn/pricing
gpt-4o-mini-2024-07-18,1232,1221,1284,0.15,2024-07,,https://openai.com/api/pricing/
gemini-1.5-flash-002,1227,1214,1253,0.075,2024-10,,
llama-3.1-nemotron-70b-instruct,1214,1224,1272,0.35,2024-10,,https://openrouter.ai/nvidia/llama-3.1-nemotron-70b-instruct
claude-3-5-sonnet-20240620,1258,1269,1294,3,2024-06,,
llama-3.1-405b-instruct-fp8,1252,1248,1276,2.75,2024-07,,https://openrouter.ai/meta-llama/llama-3.1-405b-instruct
grok-2-mini-2024-08-13,1223,1220,1261,,2024-08,,
gemini-advanced-0514,1253,1237,1254,,2024-05,,
llama-3.1-405b-instruct-bf16,1251,1253,1284,2,2024-06,,https://openrouter.ai/models/meta-llama/llama-3.1-405b
yi-lightning-lite,1236,1234,1267,,2024-10,,
gpt-4o-2024-08-06,1249,1238,1273,2.5,2024-08,,https://openai.com/api/pricing/
qwen-max-0919,1229,1232,1279,,,,
gemini-1.5-pro-001,1239,1237,1262,3.5,2024-05,,https://ai.google.dev/pricing
qwen2.5-72b-instruct,1221,1226,1281,0.35,2024-09,,https://openrouter.ai/models/qwen/qwen-2.5-72b-instruct
deepseek-v2.5,1223,1233,1288,0.14,2024-08,,https://openrouter.ai/models/deepseek/deepseek-chat
gpt-4-turbo-2024-04-09,1241,1226,1262,10,2024-04,,https://openai.com/api/pricing/
mistral-large-2407,1230,1231,1269,2,2024-07,,https://openrouter.ai/models/mistralai/mistral-large
athene-70b-0725,1221,1224,1253,,2024-07,,
gpt-4-1106-preview,1234,1226,1252,10,2023-11,,https://openai.com/api/pricing/
claude-3-opus-20240229,1238,1234,1250,15,2024-02,,
llama-3.1-70b-instruct,1212,1210,1250,0.52,2024-06,,https://openrouter.ai/models/meta-llama/llama-3.1-70b-instruct
gpt-4-0125-preview,1230,1218,1243,10,2024-01,,https://openai.com/api/pricing/
yi-large-preview,1206,1205,1245,,2024-07,,
reka-core-20240722,1203,1186,1208,,2024-07,,
qwen-plus-0828,1205,1208,1245,,2024-08,,
gemini-1.5-flash-001,1202,1200,1231,0.075,2024-08,,https://ai.google.dev/pricing
jamba-1.5-large,1203,1192,1228,2,2024-08,,https://openrouter.ai/models/ai21/jamba-1-5-large
deepseek-v2-api-0628,1201,1210,1241,0.14,2024-06,,
gemma-2-27b-it,1205,1192,1209,0.27,2024-06,,https://openrouter.ai/models/google/gemma-2-27b-it
command-r-plus-08-2024,1196,1171,1181,,2024-08,,
gemma-2-9b-it-simpo,1198,1185,1197,,,,
deepseek-coder-v2-0724,1196,1210,1266,0.14,2024-07,,
yi-large,1194,1185,1219,3,2023-10,,https://openrouter.ai/models/01-ai/yi-large
gemini-1.5-flash-8b-001,1176,1171,1204,0.0375,2024-10,,
llama-3.1-nemotron-51b-instruct,1203,1192,1211,0.35,2024-10,,https://openrouter.ai/nvidia/llama-3.1-nemotron-70b-instruct
nemotron-4-340b-instruct,1195,1188,1197,4.2,2024-06,,https://openrouter.ai/models/nvidia/nemotron-4-340b-instruct
glm-4-0520,1187,1188,1215,0.66,2024-05,,https://open.bigmodel.cn/pricing
llama-3-70b-instruct,1194,1187,1199,0.59,2024-04,,https://openrouter.ai/models/meta-llama/llama-3-70b-instruct
gemini-1.5-flash-8b-exp-0827,1171,1162,1189,,,,
claude-3-sonnet-20240229,1197,1190,1212,3,2024-02,,
reka-flash-20240722,1180,1164,1187,,,,
reka-core-20240501,1176,1167,1189,,2024-05,,
gemma-2-9b-it,1177,1160,1169,0.2,2024-06,,https://openrouter.ai/models/google/gemma-2-9b-it
command-r-plus,1182,1159,1164,3,2024-01,,
hunyuan-standard-256k,1149,1180,1224,,,,
qwen2-72b-instruct,1180,1178,1186,0.34,2024-06,,https://openrouter.ai/qwen/qwen-2-72b-instruct
gpt-4-0314,1199,1202,1195,30,2024-03,,https://platform.openai.com/docs/deprecations/
glm-4-0116,1162,1164,1190,,2024-01,,
qwen-max-0428,1171,1167,1189,,2024-04,,
claude-3-haiku-20240307,1177,1174,1189,0.25,2024-03,,
command-r-08-2024,1175,1165,1161,,,,
ministral-8b-2410,1159,1166,1201,0.1,2024-10,,https://openrouter.ai/mistralai/ministral-8b
deepseek-coder-v2,1181,1196,1238,0.14,2024-07,,https://openrouter.ai/models/deepseek/deepseek-coder
jamba-1.5-mini,1159,1145,1181,0.2,2024-08,,https://openrouter.ai/models/ai21/jamba-1-5-mini
llama-3.1-8b-instruct,1131,1141,1186,0.06,2024-06,,https://openrouter.ai/models/meta-llama/llama-3.1-8b-instruct
reka-flash-preview-20240611,1151,1136,1154,,,,
gpt-4-0613,1185,1181,1166,30,2024-06,,https://platform.openai.com/docs/deprecations/
qwen1.5-110b-chat,1155,1154,1174,1.62,2024-04,,https://openrouter.ai/models/qwen/qwen-110b-chat
yi-1.5-34b-chat,1132,1135,1162,,2024-05,,
mistral-large-2402,1157,1164,1169,8,2023-11,,
reka-flash-21b-20240226-online,1151,1143,1146,,2024-02,,
llama-3-8b-instruct,1142,1128,1145,0.05,2024-04,,
internlm2_5-20b-chat,1115,1142,1158,,,,
claude-1,1158,1135,1135,8,2023-03,,
command-r,1147,1122,1122,0.5,2023-12,,
reka-flash-21b-20240226,1141,1134,1141,,2024-02,,
qwen1.5-72b-chat,1147,1142,1159,0.81,2024-01,,https://openrouter.ai/models/qwen/qwen-72b-chat
mistral-medium,1141,1136,1152,2.7,2023-11,,
mixtral-8x22b-instruct-v0.1,1149,1146,1152,0.7,2024-05,,
gemma-2-2b-it,1113,1094,1104,0.06,2024-06,,https://openrouter.ai/google/gemma-2-9b-it
gemini-pro-dev-api,1146,1124,1102,0.5,2024-01,,https://ai.google.dev/pricing
claude-2.0,1145,1141,1135,8,2023-07,,
zephyr-orpo-141b-A35b-v0.1,1130,1119,1124,,,,
qwen1.5-32b-chat,1126,1131,1149,0.72,2023-11,,https://openrouter.ai/models/qwen/qwen-32b-chat
mistral-next,1149,1148,1132,,,,
phi-3-medium-4k-instruct,1117,1121,1125,,,,https://openrouter.ai/microsoft/phi-3-medium-4k-instruct
starling-lm-7b-beta,1091,1103,1129,,2024-03,,
claude-2.1,1134,1135,1131,8,2023-11,,
gpt-3.5-turbo-0613,1136,1134,1134,1.5,2023-06,,https://openai.com/api/pricing/
mixtral-8x7b-instruct-v0.1,1114,1114,1114,0.3,2024-03,,
yi-34b-chat,1111,1101,1089,0.72,2023-11,,https://openrouter.ai/models/01-ai/yi-34b-chat
claude-instant-1,1111,1106,1124,0.8,2023-03,,
gemini-pro,1110,1083,1113,0.5,2023-12,,https://ai.google.dev/pricing
qwen1.5-14b-chat,1108,1116,1109,0.27,2023-09,,https://openrouter.ai/models/qwen/qwen-14b-chat
wizardlm-70b,1105,1077,1074,,,,
gpt-3.5-turbo-0314,1106,1117,1138,0.5,2023-03,,
gpt-3.5-turbo-0125,1105,1111,1130,0.5,2024-01,,
dbrx-instruct-preview,1103,1109,1115,,,,
llama-3.2-3b-instruct,1102,1102,1084,,,,
phi-3-small-8k-instruct,1101,1107,1101,,,,
tulu-2-dpo-70b,1099,1098,1088,,,,
llama-2-70b-chat,1093,1070,1063,0.64,2023-07,,
granite-3.0-8b-instruct,1094,1110,1120,,2024-11,,
openchat-3.5-0106,1091,1083,1088,0.13,2024-01,,
vicuna-33b,1090,1066,1066,,,,
snowflake-arctic-instruct,1090,1073,1088,2.16,2023-12,,https://openrouter.ai/models/snowflake/snowflake-arctic-instruct
starling-lm-7b-alpha,1088,1072,1070,,,,
nous-hermes-2-mixtral-8x7b-dpo,1084,1052,1036,,,,
gemma-1.1-7b-it,1083,1076,1095,0.1,2024-04,,
llama2-70b-steerlm-chat,1080,1045,1048,,2023-07,,
pplx-70b-online,1077,1028,1030,1,2024-02,,
deepseek-llm-67b-chat,1076,1065,1072,,,,
openchat-3.5,1076,1065,1076,0.13,2024-01,,
openhermes-2.5-mistral-7b,1074,1068,1077,,,,
mistral-7b-instruct-v0.2,1072,1068,1063,0.06,2023-12,,
granite-3.0-2b-instruct,1075,1090,1095,,2024-11,,
qwen1.5-7b-chat,1070,1066,1057,0.18,2023-09,,https://openrouter.ai/models/qwen/qwen-7b-chat
phi-3-mini-4k-instruct-june-2024,1070,1095,1088,,,,
gpt-3.5-turbo-1106,1067,1090,1118,0.5,2023-11,,
phi-3-mini-4k-instruct,1066,1078,1066,,2024-05,,
llama-2-13b-chat,1063,1049,1043,0.1,2023-07,,
dolphin-2.2.1-mistral-7b,1062,1050,1053,,,,
solar-10.7b-instruct-v1.0,1062,1055,1055,,,,
wizardlm-13b,1058,1013,1014,,,,
zephyr-7b-beta,1053,1026,1022,,,,
llama-3.2-1b-instruct,1053,1060,1039,,,,
mpt-30b-chat,1045,1048,1055,,,,
pplx-7b-online,1044,1016,1017,0.2,2024-02,,
codellama-34b-instruct,1042,1027,1031,,,,
vicuna-13b,1042,1025,1035,,,,
zephyr-7b-alpha,1040,1022,1024,,,,
codellama-70b-instruct,1040,1051,1059,,,,
gemma-7b-it,1037,1044,1055,0.1,2024-04,,
phi-3-mini-128k-instruct,1036,1035,1040,,2024-05,,
llama-2-7b-chat,1036,1009,1003,0.56,2023-07,,
qwen-14b-chat,1035,1023,1038,,,,
falcon-180b-chat,1033,1000,1019,,,,
guanaco-33b,1032,1000,1004,,,,
gemma-1.1-2b-it,1020,1015,1042,,2024-04,,
stripedhyena-nous-7b,1017,995,1006,,,,
olmo-7b-instruct,1015,994,978,,,,
mistral-7b-instruct,1008,1002,1015,0.11,2023-09,,
vicuna-7b,1005,989,1001,,,,
palm-2,1003,1000,1036,,,,
gemma-2b-it,989,987,1008,,,,
qwen1.5-4b-chat,988,977,995,0.09,2023-09,,https://openrouter.ai/models/qwen/qwen-4b-chat
koala-13b,964,925,931,,,,
chatglm3-6b,955,953,962,,,,
gpt4all-13b-snoozy,932,931,957,,,,
mpt-7b-chat,927,891,924,,,,
chatglm2-6b,924,915,927,,,,
RWKV-4-Raven-14B,921,891,911,,,,
alpaca-13b,901,819,887,,,,
oasst-pythia-12b,893,880,913,,,,
chatglm-6b,879,894,897,,,,
fastchat-t5-3b,867,809,832,,,,
stablelm-tuned-alpha-7b,839,830,841,,,,
dolly-v2-12b,821,798,855,,,,
llama-13b,799,722,796,,,,
yi-34b-chat,1100,1090,1106,0.72,2023-11,,https://openrouter.ai/models/01-ai/yi-34b-chat
claude-instant-1,1126,1124,1108,0.8,2023-03,,
gemini-pro,1131,1113,1091,0.5,2023-12,,https://ai.google.dev/pricing
qwen1.5-14b-chat,1106,1109,1125,0.27,2023-09,,https://openrouter.ai/models/qwen/qwen-14b-chat
wizardlm-70b,1104,1074,1070,,,,
gpt-3.5-turbo-0314,1141,1138,1114,0.5,2023-03,,
gpt-3.5-turbo-0125,1137,1130,1123,0.5,2024-01,,
dbrx-instruct-preview,1113,1115,1117,,,,
llama-3.2-3b-instruct,1092,1084,1080,,,,
phi-3-small-8k-instruct,1098,1101,1107,,,,
tulu-2-dpo-70b,1092,1088,1093,,,,
llama-2-70b-chat,1081,1063,1072,0.64,2023-07,,
granite-3.0-8b-instruct,1110,1120,1098,,2024-11,,
openchat-3.5-0106,1100,1088,1102,0.13,2024-01,,
vicuna-33b,1091,1066,1067,,,,
snowflake-arctic-instruct,1102,1088,1076,2.16,2023-12,,https://openrouter.ai/models/snowflake/snowflake-arctic-instruct
starling-lm-7b-alpha,1082,1070,1079,,,,
nous-hermes-2-mixtral-8x7b-dpo,1071,1036,1079,,,,
gemma-1.1-7b-it,1098,1095,1084,0.1,2024-04,,
llama2-70b-steerlm-chat,1074,1048,1022,,2023-07,,
pplx-70b-online,1075,1030,1028,1,2024-02,,
deepseek-llm-67b-chat,1090,1072,1079,,,,
openchat-3.5,1094,1076,1053,0.13,2024-01,,
openhermes-2.5-mistral-7b,1089,1077,1057,,,,
mistral-7b-instruct-v0.2,1067,1063,1073,0.06,2023-12,,
granite-3.0-2b-instruct,1082,1095,1088,,2024-11,,
qwen1.5-7b-chat,1064,1057,1088,0.18,2023-09,,https://openrouter.ai/models/qwen/qwen-7b-chat
phi-3-mini-4k-instruct-june-2024,1067,1088,1082,,,,
gpt-3.5-turbo-1106,1109,1118,1094,0.5,2023-11,,
phi-3-mini-4k-instruct,1055,1066,1085,,2024-05,,
llama-2-13b-chat,1053,1043,1051,0.1,2023-07,,
dolphin-2.2.1-mistral-7b,1068,1054,1024,,,,
solar-10.7b-instruct-v1.0,1065,1055,1045,,,,
wizardlm-13b,1063,1014,1025,,,,
zephyr-7b-beta,1049,1022,1029,,,,
llama-3.2-1b-instruct,1044,1039,1046,,,,
mpt-30b-chat,1059,1056,1030,,,,
pplx-7b-online,1041,1017,1015,0.2,2024-02,,
codellama-34b-instruct,1047,1031,1041,,,,
vicuna-13b,1058,1035,1032,,,,
zephyr-7b-alpha,1045,1025,1034,,,,
codellama-70b-instruct,1037,1059,1047,,,,
gemma-7b-it,1047,1055,1046,0.1,2024-04,,
phi-3-mini-128k-instruct,1048,1040,1029,,2024-05,,
llama-2-7b-chat,1024,1003,1002,0.56,2023-07,,
qwen-14b-chat,1056,1038,1056,,,,
falcon-180b-chat,1058,1019,1016,,,,
guanaco-33b,1039,1004,965,,,,
gemma-1.1-2b-it,1039,1042,1036,,2024-04,,
stripedhyena-nous-7b,1033,1006,999,,,,
olmo-7b-instruct,993,978,1016,,,,
mistral-7b-instruct,1026,1015,1007,0.11,2023-09,,
vicuna-7b,1021,1001,981,,,,
palm-2,1042,1036,990,,,,
gemma-2b-it,1007,1008,1000,,,,
qwen1.5-4b-chat,1014,995,990,0.09,2023-09,,https://openrouter.ai/models/qwen/qwen-4b-chat
koala-13b,979,931,937,,,,
chatglm3-6b,974,962,952,,,,
gpt4all-13b-snoozy,972,957,909,,,,
mpt-7b-chat,967,924,899,,,,
chatglm2-6b,942,927,892,,,,
RWKV-4-Raven-14B,949,911,896,,,,
alpaca-13b,967,887,789,,,,
oasst-pythia-12b,931,913,873,,,,
chatglm-6b,888,897,883,,,,
fastchat-t5-3b,896,832,759,,,,
stablelm-tuned-alpha-7b,858,841,858,,,,
dolly-v2-12b,881,855,746,,,,
llama-13b,867,796,669,,,,

0 comments on commit 4218b82

Please sign in to comment.