A bit far away from St Remy expect 5 to 6 hours driving time back and forth plus the time you'll spend on the narrow bendy roads along the gorges. So I recommend staying overnight in Moustiers Ste Marie, Castellane or another village.
Especially if you want to enjoy the Verdon itself, rafting, canoing or only "pedalo on the lake". For nature lover it is eyes candy all the way trhough.
From Moustiers Sainte Marie, take the D952 towards Castellane. If you want to have the most drastic view, I recommend taking the "route des crêtes" but have to warn you that the road is small and bendy...
Otherwise, as we did you may drive to Castellane and enjoy the scenery or turn en route onto the D955 towards Trigance, then D90 and D71 taking you back towards Moustiers on the other bank.
Expect a 4/5 hours round trip.
Here are some pictures of that route as we did it on April 10th.