-
Notifications
You must be signed in to change notification settings - Fork 62
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Added a more optimal claude prompt #184
Conversation
{table_metadata_string} | ||
{k_shot_prompt} | ||
### Response: | ||
{cot_instructions}Given the database schema, here is the SQL query that answers `{user_question}`: | ||
```sql |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ooh anthropic performs better without cot?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yup slightly worse – which makes sense I guess! Larger model = more attention heads = better ability to pay attention to DDLs!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Ahh yes makes sense when you explain it
query_generators/anthropic.py
Outdated
messages = [ | ||
{"role": "user", "content": [{"type": "text", "text": user_prompt}]} | ||
] | ||
prompt |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
were you intending to do something here?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ah whoops was a typo – fixed now, thanks!
No description provided.