When in worlds with no collision for portal placement, the portal remains stuck in a particular location (
not
world origin) where it disconnects from the raycast (without turning red) and locks your (desktop) camera from moving until you close and re-open your quick menu. Haven't tested while falling yet but I would assume it'd be similar.