Spout input or Webcam input IN-TO VRChat, for local real-time video streams
Leo Foxx
Feature Request: It would be awesome to get a real-time video stream
in-to
VRChat for the local user. This could be used for things like playing a game or emulator, local movies, YouTube show up on a big screen in-world to watch, or for more advanced setups like AV control systems for clubs to allow for real-time control & preview.The goal of this is to provide a method of getting a video input into VRChat in real time, though this is only applicable to the local client as you can't send Spout/Webcam inputs over the internet without encoding. The typical method to accomplish this is to encode your stream to a local relay or one on the internet (such as VRCDN) and play it back in a video player, but you run into some significant issues including latency and loss of quality.
This would be beneficial to those who need real-time viewing into the world or control over in-world systems, such as controlling lights in a club to see what you're doing in real-time. This ideally uses a Spout receiver, or a webcam input, such as using OBS's Virtual Camera. This may require world creators or video-players to update their systems to enable support for such a function.
Log In
Llamahat
This would be amazing just to have a local vis for lighting and visuals rather than running it through CDN.
ValueFactory
This would be incredibly beneficial for local streaming of club video content for production (e.g producing sets for a club like Furality Club F.Y.N.N).
Our tools (Resolume, OBS, etc) already emit Spout shared textures. With native Spout reading in VRChat, we'd skip encoding/streaming middlemen like MediaMTX which have been a source of pain, inconsistencies, latency. Spout input support would thus greatly improve speed of iteration and quality of productions.
Mіcca
Not sure about the other uses, but for club worlds, being able to get video into a world in real time allows Lighting Designers to pipe DMX data directly into a world they are programming, and VJs and DJs work on effects directly, instead of having to use high latency hops through VRCDN or MediaMTX or otherwise into an in-world media player.
To be clear, this would be primarily for local programming & testing, where latency matters. Obviously to get this out to everyone else you'd still need to use an external service/CDN.