💡 [REQUEST] - Add a Multimodal Streaming Gradio Demo

[freddyaboulton]

起始日期 | Start Date

No response

实现PR | Implementation PR

No response

相关Issues | Reference Issues

No response

摘要 | Summary

Hello, it is possible to build multimodal streaming (both audio and video input/output) demos with Gradio and WebRTC using gradio-webrtc.

See this demo.

gemini-audio-video-first.mp4

基本示例 | Basic Example

See above^

缺陷 | Drawbacks

No drawbacks - it gives developers a new way to interact with miniCPM-o that showcases it's streaming capabilities.

未解决问题 | Unresolved questions

No response

[bitnom]

I'm working to hook it up to my edge framework. I'll add gradio webrtc to my list of things to do, assuming I can get it onto our tracks (I don't see why not)

[freddyaboulton]

Great !