Do not hold it in the air when activating travel mode. The legs will raise to flying mode (it will not stop at travel mode and continue to raise up).
Just make sure your inspire and remote are connected (green light on the remote). I never had issue activating the travel mode on the remote.