The keybindings you set in the VRChat Configuration window will only work while loading it this way.
If you change a keybinding and start the game it will work.
But if you restart the game and don't go via the VRChat Configuration window the keybinding you have set will not work.
Because I don't have a US keyboard I have to change the debug keybindings, but it will only work if I load the game via the VRChat Configuration window.
Repo steps:
  • Start the game while holding shift
  • Change the keybindings for the debug keys
  • Click Play! and press the keys when it's loaded to make sure it working
  • Restart the game, but this time don't hold shift.
  • Press the same bindings