Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updates planned capabilities #460

Merged
merged 1 commit into from
Dec 5, 2024
Merged

Updates planned capabilities #460

merged 1 commit into from
Dec 5, 2024

Conversation

skrawcz
Copy link
Contributor

@skrawcz skrawcz commented Dec 5, 2024

This was stale and behind.

Changes

How I tested this

Notes

Checklist

  • PR has an informative and human-readable title (this will be pulled into the release notes)
  • Changes are limited to a single goal (no scope creep)
  • Code passed the pre-commit check & code is left cleaner/nicer than when first encountered.
  • Any change in functionality is tested
  • New functions are documented (with a description, list of inputs, and expected output)
  • Placeholder code is flagged / future TODOs are captured in comments
  • Project documentation has been updated if adding/changing functionality.

Important

Updates planned-capabilities.rst to reflect current and future evaluation, annotation, and integration capabilities.

  • Evaluation & Annotation:
    • Updated section to include plans for metrics and custom callbacks/LLM as judge capabilities.
    • Added SDK functionality for programmatic annotation, evaluation, export, and search.
  • Integrations:
    • Updated to reflect current support for Haystack, Hamilton, and LangChain.
  • Misc:
    • Renamed section from "UI-based annotations" to "Evaluation & Annotation integrations".

This description was created by Ellipsis for deac7e7. It will automatically update as commits are pushed.

This was stale and behind.
@skrawcz skrawcz merged commit 8c573e9 into main Dec 5, 2024
4 checks passed
@skrawcz skrawcz deleted the fix_docs branch December 5, 2024 19:23
Copy link

@ellipsis-dev ellipsis-dev bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 Looks good to me! Reviewed everything up to deac7e7 in 12 seconds

More details
  • Looked at 31 lines of code in 1 files
  • Skipped 0 files when reviewing.
  • Skipped posting 1 drafted comments based on config settings.
1. docs/concepts/planned-capabilities.rst:16
  • Draft comment:
    Consider rephrasing for clarity:
1. Integrate metrics and custom callbacks/LLM as judge capabilities to evaluate captured and annotated data.
  • Reason this comment was not posted:
    Confidence changes required: 50%
    The sentence on line 16 is unclear and could be rephrased for better readability.

Workflow ID: wflow_b2u36DLxuEeYEnla


You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.

Copy link

github-actions bot commented Dec 5, 2024

A preview of is uploaded and can be seen here:

https://burr.dagworks.io/pull/460

Changes may take a few minutes to propagate. Since this is a preview of production, content with draft: true will not be rendered. The source is here: https://github.com/DAGWorks-Inc/burr/tree/gh-pages/pull/460/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant