you can still connect to via controller or phone, whichever it is setup for. I'd keep it handy in those cases.
I always use the controller, but always also to gesture control launch using the double tap on the battery, I then go into the app and change it from gesture to "normal"