Agents: Example of observability for CrewAI

[sfc-gh-jreini]

Description

Changes added to base crewai example:

• @instrument decorator added to tasks and agents in crew.py
• Crew is instantiated in main.py and wrapped with TruCustomApp
• crew is run in main.py using wrapped app trulens recorder as context manager

Other details good to know for developers

Current issues to sort through observed in experiments.

• Not considering evals yet
• The recording seems to end after 20 seconds or so. This could be due to the initial process ending.
• True function names are obscured and recorded as memoized_func which is how CrewAI wraps their functions.
• Input/output is not recorded correctly.

What is working well:

• the trace details are included, so you can inspect the details of each agent/task

Type of change

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to
  not work as expected)
• New Tests
• This change includes re-generated golden test results
• This change requires a documentation update

[review-notebook-app]

Check out this pull request on 

See visual diffs & provide feedback on Jupyter Notebooks.

---

Powered by ReviewNB