Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

EPIC - Build a installation and evaluation workflow #139

Open
3 tasks
AndreasThinks opened this issue Jul 26, 2024 · 1 comment
Open
3 tasks

EPIC - Build a installation and evaluation workflow #139

AndreasThinks opened this issue Jul 26, 2024 · 1 comment

Comments

@AndreasThinks
Copy link
Contributor

AndreasThinks commented Jul 26, 2024

We should aim to reach a stage where you can roll out Caddy, while measuring quality and allowing LCA level variability.

This should include:

  • A repeatable and robust evaluation process allowing measure quality around our gold standard
  • An installation flow
  • Begin exploring customisable LCA levels (such as approval level)
@AndreasThinks AndreasThinks added this to the 1.1 milestone Jul 26, 2024
@AndreasThinks
Copy link
Contributor Author

This is now our primary epic. We need a flow that lets you:

  • Collect a set of perfect Q&A
  • Input your initial prompts
  • see how they perform over time
  • let's you know when they have reached a specific milestone.

@AndreasThinks AndreasThinks changed the title EPIC - We need to look into how we evaluate different prompts and structures Build an evaluation workflow Oct 18, 2024
@AndreasThinks AndreasThinks changed the title Build an evaluation workflow EPIC - Build an evaluation workflow Oct 18, 2024
@AndreasThinks AndreasThinks changed the title EPIC - Build an evaluation workflow EPIC - Build a installation and evaluation workflow Oct 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant