Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Third party integration - Langtrace with Mistral for open source LLM observability #112

Merged
merged 7 commits into from
Dec 2, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -62,6 +62,7 @@ Disclaimer: Examples contributed by the community and partners do not represent
| [Indexify Integration - PDF Summarization](third_party/Indexify/pdf-summarization) | summarization, PDF | Indexify |
| [langgraph_code_assistant_mistral.ipynb](third_party/langchain/langgraph_code_assistant_mistral.ipynb) | code | Langchain |
| [langgraph_crag_mistral.ipynb](third_party/langchain/langgraph_crag_mistral.ipynb) | RAG | Langchain |
| [langtrace_mistral.ipynb](third_party/langtrace/langtrace_mistral.ipynb) | OTEL Observability | Langtrace |
| [llamaindex_agentic_rag.ipynb](third_party/LlamaIndex/llamaindex_agentic_rag.ipynb) | RAG, agent | LLamaIndex |
| [llamaindex_mistralai_finetuning.ipynb](third_party/LlamaIndex/llamaindex_mistralai_finetuning.ipynb) | fine-tuning | LLamaIndex |
| [llamaindex_mistral_multi_modal.ipynb](third_party/LlamaIndex/llamaindex_mistral_multi_modal.ipynb) | MultiModalLLM-Pixtral | LLamaIndex |
Expand Down
19 changes: 19 additions & 0 deletions third_party/Langtrace/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
# Trace and Observe your Mistral AI Models with Langtrace

## What is Langtrace?
Langtrace [(GitHub)](https://github.com/Scale3-Labs/langtrace) is an open-source and open telemetry based LLM application observability platform.

## What can Langtrace help you with?
- Capture model traces that is rich in metadata such as prompts, completions and hyper parameter settings.
- Capture traces from all the other parts of your stack such as vector DB, framrworks etc.
- Annotate and evaluate model generations to measure baseline performance and accuracy.
- Run automated evaluations to test for regressions and compare models/model settings.
- Manage and version control prompts.

## How to get started with Langtrace?
- Head over to https://langtrace.ai and sign up for a free account.
- Create a project and grab your API key.
- Follow the instructions on this [notebook](langtrace_mistral.ipynb)

## Feedback
If you have any feedback, please create a GitHub [Issue](https://github.com/Scale3-Labs/langtrace/issues) or reach out to us directly on [Discord](https://discord.langtrace.ai/).
Binary file added third_party/Langtrace/TraceTree1.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added third_party/Langtrace/TraceTree2.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added third_party/Langtrace/constitution.pdf
Binary file not shown.
1 change: 1 addition & 0 deletions third_party/Langtrace/langtrace_mistral.ipynb

Large diffs are not rendered by default.

Binary file added third_party/Langtrace/mistral-langtrace1.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added third_party/Langtrace/mistral-langtrace2.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
8 changes: 8 additions & 0 deletions third_party/Langtrace/requirements.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
mistralai
langchain
langchain-community
chromadb
python-dotenv
langtrace-python-sdk
pypdf