Skip to content

Commit

Permalink
Update report.md
Browse files Browse the repository at this point in the history
  • Loading branch information
lgabs authored Nov 10, 2024
1 parent 051328e commit 53b4ed1
Showing 1 changed file with 3 additions and 2 deletions.
5 changes: 3 additions & 2 deletions exams/ita_2025/report.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,6 @@
The Instituto Tecnológico de Aeronáutica (ITA) entrance exam for 2025 consists of two phases:

- **Phase 1**:
- Written exams covering the subjects listed in the Examination Program found in ANNEX D and available on the ITA Vestibular website.
- The exam includes 48 multiple-choice questions, divided into:
- 12 questions in Mathematics
- 12 questions in Physics
Expand All @@ -16,6 +15,8 @@ The Instituto Tecnológico de Aeronáutica (ITA) entrance exam for 2025 consists
- An argumentative essay.
- 15 objective questions in Portuguese.

See more details in the [official exam announcemnt](https://vestibular.ita.br/instrucoes/edital_2025.pdf).

## Results

| Exam | Phase | Section | Type | Model | Status | Score |
Expand All @@ -28,4 +29,4 @@ The Instituto Tecnológico de Aeronáutica (ITA) entrance exam for 2025 consists

## Comments

`o1-preview` almost got all questions correct in the Math essay exam. The only question it got wrong was question 10, which is a question about spacial geometry, which is a known area of weakness for LLMs. After running that question several times, it can get it correct sometimes, but not always. Since it did not got it correct in the first try, it was considered wrong. Check one of these correct answers [here](exams/ita_2025/math/essays/solutions/q10_solution_rerun.txt).
`o1-preview` almost got all questions correct in the Math essay exam. The only question it got wrong was question 10, which is a question about spacial geometry, which is a known area of weakness for LLMs. After running that question several times, it can get it correct sometimes, but not always. Since it did not got it correct in the first try, it was considered wrong. Check one of these correct answers [here](exams/ita_2025/math/essays/solutions/q10_solution_rerun.txt).

0 comments on commit 53b4ed1

Please sign in to comment.