It's only going to slow down the process a few seconds. If you are bringing mage + range it's still going to be faster to use loadouts because you need to go through the choose-x option when grabbing runes + bolts.
Home tele -> go to zammy mage through edge bank & using loadout -> go to wizard and you are back
I think there should be a penalty timer of around 1-2 minutes which disables you from entering the wilderness after using a loadout
