Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bug: CodingMentor Suggests Modifying Test Suite Instead of Fixing Buggy Code #33

Open
hemanialaparthi opened this issue Oct 3, 2024 · 6 comments
Assignees
Labels
bug Something isn't working enhancement New feature or request

Comments

@hemanialaparthi
Copy link
Collaborator

Occasionally, when the advice model is executed, the output suggests modifying the test suite to pass the build rather than addressing the buggy code causing the test case errors. This behavior could be due to an issue with the prompts being sent to the API

@hemanialaparthi hemanialaparthi added bug Something isn't working enhancement New feature or request labels Oct 3, 2024
@hemanialaparthi hemanialaparthi self-assigned this Oct 3, 2024
@PCain02
Copy link
Collaborator

PCain02 commented Oct 17, 2024

I suggest we send not only the prompts but also the source code to the coding mentor so it can not only have the tests that fail but also the buggy code.

@gkapfham
Copy link
Collaborator

Hello @PCain02 and @hemanialaparthi can you please give a status update for this feature?

@boulais01
Copy link
Collaborator

@PCain02 and @hemanialaparthi, this has gone 2 weeks without a status update; would you mind letting us know if there's any progress here?

@PCain02
Copy link
Collaborator

PCain02 commented Nov 10, 2024

Yep here is my draft pull request #48

@gkapfham
Copy link
Collaborator

Hi @hemanialaparthi is this issue connected to any other issues?

@gkapfham
Copy link
Collaborator

Hi @PCain02 is your PR finalized now? I had the impression that it was. Correct?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

4 participants