[1344] Video player stuttering when client framerate drops below Unity video player framerate
tracked
Natsumi-sama
When playing a video with Unity video player at high FPS (e.g. from this video 60FPS) the video and audio aggressively stutter when client frame rate drops below the videos frame rate. I remember this issue from a long time ago and it seems to have resurfaced.
Log In
StormRel
Merged in a post:
[1357] In low FPS environments, UnityVideoPlayer causes fatal audio/video frame frop
Sayamame
When playing video in a video player using UnityVideoPlayer (e.g. KineLVideoPlayer, iwaSync3, and USharpVideo), if the VRChat fps is lower than the frame rate of the video, frame drops will occur.
Video continues to play with audio chopping and visual freezing.
In live, the audio is seamless and the visuals are played according to the fps.
Quest environment is not tested.
This also occurs with low FPS due to FPS Capping Limit of the VRChat feature.
I tried to check the log, but
--enable-sdk-log-levels
option had no effect. (There is no related log.)Note that this problem may not occur for a while.
I tried to reproduce this with various videos (over 2h, etc.) and finally reproduced it after about 30 minutes from beginning of reproduction test.
Once this started to occur, changing instances or restarting the PC or VRChat had no effect, and the problem is easily reproduced in many videos.
[Reproduction Steps]
- Play some video.
- Open Graphics settings and set the FPS Limit to 10.
- Audio/Video frame drop occured.
Reproduction example video with playing https://www.youtube.com/watch?v=_YPQtxnQTN0 (25fps)
[Experiment for this]
I tried this in YouTube video with 24fps and 30fps.
The audio is chopped for the number of frames that are dropped every second.
I measured this manually, and it looks like the following
- 24fps video
1 chopping per second for 23fps upper limit, 2 for 22fps, 4-5 for 20fps
- 30fps video
1 chopping per second for 29fps upper limit, 2 for 28fps, 5 for 25fps
The visual freezing is terrible, which is clearly shown by the playback time of the video.
This canny (https://feedback.vrchat.com/open-beta/p/1346-avpro-with-fps-lower-than-30-may-cause-audio-frame-drop) seems similar, but I could not reproduce this for now.
owlboy
I have a suspicion
[1344] SteamVR Resolution Changes Breaks Video Players On Load
is a totally separate issue and should not have been merged with this one.StormRel
tracked
shammy
Yep I've been getting this too. I remember it being a thing like 3 years ago but it's returned in this beta.
I was getting it in an instance last night whilst in the beta then switched to live and returned to the same instance and didn't have the issue anymore.
owlboy
This was an issue in the past.