Do what you must. Just be sure to dock at Pier 39 and have a bite to eat at 'The Franciscan'. It's one of my go-to's when I visit the bay area.