Skip to content

V1.1.0 Metrics & Reliability Enhancement

Latest
Compare
Choose a tag to compare
@alimosaed alimosaed released this 25 Feb 20:20
· 3 commits to main since this release
0f81615

🆕 What's New?

  • Added comprehensive LLM metrics reporting
    • Tracks input/output/total tokens and response time
    • Periodic memory management for metrics storage
  • Enhanced vector database support
    • Added support for Quadrant and PGVector
    • Implemented configurable text splitter functionality
    • Improved metadata handling for vector chunks

🔧 Improvements

  • Development Broker Improvements
    • Added mock implementations for metrics and connection status
    • Introduced dev_mode configuration
      • New unified control for broker selection
      • Backwards compatible implementation
  • Stability & Error Handling
    • Improved connection handling and termination
      • Added exception handling for workflow creation
      • Enhanced signal handling
    • Added message acknowledgment for request-response flows
    • Implemented maximum message redelivery count
    • Enhanced MongoDB error handling and validation
    • Added validation for LLM model configurations
    • Improved connection status logging
  • Security Updates
    • Resolved multiple security vulnerabilities
      • Updated PIP dependencies
      • Upgraded Socket.io
      • Updated Setuptools

🐛 Bug Fixes

  • Fixed LiteLLM configuration issues
    • Resolved runtime error in configuration
    • Fixed metrics calculation in streaming mode
  • Improved broker type handling with default to 'solace'