Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updates planned capabilities #460

Merged
merged 1 commit into from
Dec 5, 2024
Merged

Updates planned capabilities #460

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
15 changes: 9 additions & 6 deletions docs/concepts/planned-capabilities.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,12 +7,14 @@ These are on the roadmap (and will be part of Burr in the imminent future), but
We build fast though, so let us know which ones you need and they'll be in there before you know it!


--------------------
UI-based annotations
--------------------
------------------------------------
Evaluation & Annotation integrations
------------------------------------

You can already annotate with the Burr UI. We have plans to:

We're adding the ability to annotate actions/states in the UI and download later for
analysis, debugging, etc... Please reach out if this is something you'd like to test!
1. plug in metrics and custom callbacks/LLM as judge capabilities to enable you to evaluate what captured and annotated.
2. SDK functionality to allow programmatic annotation and evaluation, as well as export and search of annotations.

-----------------------------
State Management/Immutability
Expand Down Expand Up @@ -90,4 +92,5 @@ Will have to come up with ergonomic APIs -- the above are just some ideas.
Integrations
------------

Langchain is next up (using LCEL). Please request any other integrations you'd like to see.
We already have support for Haystack, Hamilton, and LangChain.
Please request any other integrations you'd like to see.
Loading