Releases: SolaceDev/solace-ai-connector
Releases · SolaceDev/solace-ai-connector
V1.1.0 Metrics & Reliability Enhancement
🆕 What's New?
- Added comprehensive LLM metrics reporting
- Tracks input/output/total tokens and response time
- Periodic memory management for metrics storage
- Enhanced vector database support
- Added support for Quadrant and PGVector
- Implemented configurable text splitter functionality
- Improved metadata handling for vector chunks
🔧 Improvements
- Development Broker Improvements
- Added mock implementations for metrics and connection status
- Introduced dev_mode configuration
- New unified control for broker selection
- Backwards compatible implementation
- Stability & Error Handling
- Improved connection handling and termination
- Added exception handling for workflow creation
- Enhanced signal handling
- Added message acknowledgment for request-response flows
- Implemented maximum message redelivery count
- Enhanced MongoDB error handling and validation
- Added validation for LLM model configurations
- Improved connection status logging
- Improved connection handling and termination
- Security Updates
- Resolved multiple security vulnerabilities
- Updated PIP dependencies
- Upgraded Socket.io
- Updated Setuptools
- Resolved multiple security vulnerabilities
🐛 Bug Fixes
- Fixed LiteLLM configuration issues
- Resolved runtime error in configuration
- Fixed metrics calculation in streaming mode
- Improved broker type handling with default to 'solace'
V1.0.0 Enhanced Monitoring & Stability
🆕 What's New?
- Added comprehensive monitoring system for workflow status tracking
- Implemented log rotation and archiving system
- Added MongoDB integration with support for typed data insertion and JSON handling
- Introduced text splitter component using Langchain for document chunking
- Added support for custom user property keys in request-reply messaging
- Implemented error queue configuration with max depth control
- Added configurable reply topic placement in agent requests
- Added API for connection status monitoring
🔧 Improvements
- Enhanced security by removing confidential information from logs
- Improved logging system:
- Added connection/reconnection attempt logging
- Implemented log file size control and archiving
- Added exponential backoff for connection retry logging
- Enhanced LLM request handling with retry mechanisms and cooling down policies:
- Added retry based on failure types
- Implemented cooling down based on error rates
- Added timeout handling
- Introduced NACK functionality for failed requests
- Improved broker reconnection with "forever" retry policy
- Added whitesource configuration file support in CI workflow
- Enhanced error reporting during startup process
- Optimized dependencies:
- Removed Langchain and LiteLLM dependencies from core
- Improved system shutdown handling:
- Added proper SIGINT and SIGTERM signal handling
- Enhanced thread termination in sleep mode
🐛 Bug Fixes
- Fixed infinite error logging loop during broker disconnection
- Resolved graceful shutdown issues
- Fixed error handling in startup process to show error location
- Resolved broker reconnection timeout issues
- Fixed error queue blocking issues by implementing message dropping when queue is full
Note: This release includes significant improvements to system stability, monitoring, and security, along with various bug fixes and performance enhancements.