People won't tell you, but if you have Arduanatt, it may be better for you not to remove caution. This is the only horse where you may need it to be able to use double Jump and the wings, without risking to fall from the cliff, while you are at max speed. it is serious.
Caution is actually really useful for when you run into a tree mid-flight, most of the time you can just double jump and glide again after the animation triggers (as opposed to just falling straight down automatically without caution)
My Pegasus still does this without having caution on. I actually hate caution, I will never keep it on as sometimes I want to go down small declines that aren't smooth and it continually procs. Also I thought the recent changes to Pegasus meant you don't need to double jump before you start gliding and can actually stop yourself from falling? I could be wrong, never tested it myself.