Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ITA 2025 Physics Essay Exam Solutions #17

Merged
merged 18 commits into from
Nov 17, 2024

Conversation

lgabs
Copy link
Owner

@lgabs lgabs commented Nov 15, 2024

Solves #3 .Solutions can be found at Poliedro or Elite websites.

Questions added and reviewed:

  • Question 1: pass, total points: 10.
  • Question 2: pass, total points: 10.
  • Question 3: failed all three parts. It made a incorrect assumption about the relation between accelerations when the llm said a_{\text{mov}} = a_{\text{fixa}} - a_M \, \sin\alpha. total points: 0.
  • Question 4: failed on part b, when it treated the difference in kinetic energy \delta as a positive value (it said \delta = \frac{E_{\text{inicial}} - E_{\text{final}}}{E_{\text{inicial}}}, instead of negative value, which would be correct if the llm said \delta = \frac{E_{\text{final}} - E_{\text{inicial}}}{E_{\text{inicial}}}. Considering each part valued at 10/3=3.33 points, we could consider only half for part (b) for the mistake. total points: 3.33 * 2 + 3.33/2=8.33
  • Question 5: failed on part (b). When the llm said the v_{\text{NS}} &= v_0 + v_e, this is only valid if m<<M. Checking the solution, we can see that v_{\text{NS}} &= v_0 + \frac{M}{M+m} \cdot v_e, i.e., o1 would be correct only if m<<M (which is probably true in real life, but the problem statement does not says that. total points: 5
  • Question 6: pass, total points: 10.
  • Question 7: pass partially. For part (b), it got the equations to plot intensity right, but o1 is not so good yet to follow instructions to make LaTeX code to really plot images when solving the question. We can discount points since it did not make graphs, but when asking o1 directly only to plot the images from equations obtained, it produced correct graphs, which we'll include to present a better solution. Discounting half points in (b): total points: 3.33 + 3.33/2 + 3.33=8.33.
  • Question 8: failed in parts (b) and (c). o1-preview understood how the forces would act in the system, but it did not understand that \omega was not given in the problem statement and used it to answer (b). Part (c) was a terrible answer, it expressed \omega in terms of F_{\text{resultante} and then showed this force in terms of \omega, which is a circular reference. total points: 3.33 + 0 + 0 = 3.33.
  • Question 9: failed. This question involves a complex image, which we know can affect performance. First, when establishing the equilibrium of the balance, it did not consider the counterweight. Second, GPT-4 was unable to describe the image in a way that allowed the angular coefficient to be calculated, so o1 organized its solution in terms of an unknown coefficient S. total points: 0.
  • Question 10: pass. Very interesting, since it's a modern physics. total points: 10
  • Add comments about the test (summary from above comments)

Total points so far: (10+10+0+8.33+5+10+8.33+3.33+0+10) / 10 = 6.50

@lgabs lgabs changed the title Add ita 2025 Physics Essay Exam Solutions Draft: Add ita 2025 Physics Essay Exam Solutions Nov 15, 2024
@lgabs lgabs self-assigned this Nov 15, 2024
@lgabs lgabs changed the title Draft: Add ita 2025 Physics Essay Exam Solutions Add ita 2025 Physics Essay Exam Solutions Nov 16, 2024
@lgabs lgabs merged commit 9e8d610 into main Nov 17, 2024
3 checks passed
@lgabs lgabs deleted the add-ita-2025-physics-essay-exam branch November 17, 2024 15:34
@lgabs lgabs changed the title Add ita 2025 Physics Essay Exam Solutions Add ITA 2025 Physics Essay Exam Solutions Nov 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant