[Roadmap] AIOS Roadmap Q2 2024

[TataKKKL]

This document outlines the features in the AIOS roadmap for Q2 2024. Please feel free to discuss and contribute to the specific features through related Issues or PRs, and add any other topics you'd like to talk about in this issue.

Device Support & LLM inference acceleration integration

• ollama support: enable ollama #108
• vllm support on GPU

Agent configuration

• move agent creation logic from AIOS to OpenAGI
• enable tool callings
  • chatgpt-based tool calling
    feat: add tool calling for chatgpt-based math agent OpenAGI#50
    feat: add tool calling for chatgpt-based math agent #116
  • open-sourced llm tool calling
• add an agent (travel agent) with more tool callings
• add an agent with self planning and code interpretation for action execution

More & better documentation

• add evaluation script and add agent-level and request-level evaluation metrics
  • [feat] add evaluator #93
  • feat: add scheduler evaluation #96
  • 1) add dotenv, 2) add timing logic for concurrent and sequential exec… #100
• improve documentation and environment set up
  • update readme and add bash scripts #97
  • refactor: set down queue scanning time #98
  • refactor: remove redundant llm config files and update llm name in README #99
• add more benchmarks
• update the architecture diagram of AIOS

Better demo

• ChatUI

Streaming output

• Streaming output for API-based llm to support context switch

Testing

• modify unit test
  • set up test environment and clean readme OpenAGI#48
  • make pytest work on CPU #113
• add integration test
• Github workflow [Feature] Github Workflow #134

Package & Documentation

• package and release OpenAGI as the PyPI library
• package and release AIOS as executive files
  • On Linux(Debian), apt install
  • On Windows, download as .exe
  • On MacOS, brew install
• add documentation for OpenAGI and AIOS

[itsthemoon]

hi, I am interested in working on: add an agent with more tool callings

[dongyuanjushi]

A travel agent can be considered by calling multiple search tools (hotels, flights, restaurants). Or it is possible to come up with other agent, which will call multiple tools during execution. A sub-channel can be created for follow up @itsthemoon .

[itsthemoon]

A travel agent can be considered by calling multiple search tools (hotels, flights, restaurants). Or it is possible to come up with other agent, which will call multiple tools during execution. A sub-channel can be created for follow up @itsthemoon .

I created an issue here and I am currently working on the implementation.

[ArnoldIOI]

I'll be working on the langgraph -based RAG agent. I've opened a new issue here.

[zzfoo]

I'm working on the llamaindex -based RAG agent. Here is the issue.