Skip to content

Commit

Permalink
fix links
Browse files Browse the repository at this point in the history
  • Loading branch information
lgabs committed Nov 10, 2024
1 parent faec91d commit b3256f6
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions exams/ita_2025/report.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,12 +21,12 @@ See more details in the [official exam announcemnt](https://vestibular.ita.br/in

| Exam | Phase | Section | Type | Model | Status | Score | PDF Compiled |
|------|-------|---------|------|-------|--------|-------|--------------|
| ITA | 2025 | Math | Essay | o1-preview | ✅ Completed | 90%| [PDF](exams/ita_2025/math/essays/solutions/solutions_compiled.pdf) |
| ITA | 2025 | Math | Essay | o1-preview | ✅ Completed | 90%| [PDF](math/essays/solutions/solutions_compiled.pdf) |
| ITA | 2025 | Physics | Essay | o1-preview | 🚧 TODO | - | - |
| ITA | 2025 | Chemistry | Essay | o1-preview | 🚧 TODO | - | - |
| ITA | 2025 | Portuguese | Essay | o1-preview | 🚧 TODO | - | - |
| ITA | 2025 | Math | Multiple Choice | o1-preview | 🚧 TODO | - | - |

## Comments

`o1-preview` almost got all questions correct in the Math essay exam. The only question it got wrong was question 10, which is a question about spacial geometry, which is a known area of weakness for LLMs. After running that question several times, it can get it correct sometimes, but not always. Since it did not got it correct in the first try, it was considered wrong. Check one of these correct answers [here](exams/ita_2025/math/essays/solutions/q10_solution_rerun.txt).
`o1-preview` almost got all questions correct in the Math essay exam. The only question it got wrong was question 10, which is a question about spacial geometry, which is a known area of weakness for LLMs. After running that question several times, it can get it correct sometimes, but not always. Since it did not got it correct in the first try, it was considered wrong. Check one of these correct answers [here](math/essays/solutions/q10_solution_rerun.txt).

0 comments on commit b3256f6

Please sign in to comment.