Commuters are calling for the return of a direct ferry service between Manly and Barangaroo to slash travel times.