Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Portkey Observability Documentation #174

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

siddharthsambharia-portkey
Copy link

@siddharthsambharia-portkey siddharthsambharia-portkey commented Jan 31, 2025

Closes and Fixes #175

This PR adds comprehensive documentation for integrating Portkey's observability features with Mistral AI models. Portkey provides unified observability across multiple LLM providers, offering cost tracking, latency monitoring, and request tracing capabilities.
Changes

Add new section Integration with PortkeyAI under the observability documentation

  • Include Python code examples for integration
  • Add descriptions of key observability features
  • Add links to PortkeyAI documentation and GitHub repository

@siddharthsambharia-portkey
Copy link
Author

Hey @Bam4d can you take a look at this PR?

Copy link
Collaborator

@fracapuano fracapuano left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

a few minor comments, but looks good to me outside of this. Thank you!

@@ -142,6 +142,68 @@ Here is a step-by-step [example](https://github.com/mistralai/cookbook/blob/main
<img src="/img/guides/obs_langfuse2.png" alt="drawing" width="700"/>



Here's the PortkeyAI observability section in the same style as the Mistral docs:
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thank you for the PR @siddharthsambharia-portkey

I am pretty sure you did not intend to add this ;) Can you remove it please?

Here's the PortkeyAI observability section in the same style as the Mistral docs:


### Integration with PortkeyAI
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hey @siddharthsambharia-portkey thank you for this PR 🙏

May I ask you to add the block on PortkeyAI after the other observability tools already listed (that is, after phospho?). I am sure you can see why we wouldn't want to go for a free for all here ;)

Thank you so very much!

print(response.choices[0].message)
```

**Getting Started:**
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

would you add a link to the cookbook? Let's agree on which PR you rather have reviewed and then add it here! I am sure it would make using PortkeyAI muuuch easier :))

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add Portkey AI Observability Docs
2 participants