For not all worldhoppers are shardbearers wouldn't they need some control over investiture to enter shadesmar / worldhop? So if Adolin can't use Stormlight would he even be able to get to Shadesmar?
While I'm still unsure, I realized that Fabrials allow people to use Stormlight and soulcast so Adolin should be able to do it.