San Luis Obispo is a quick, 10-mile drive from Pismo Beach, and many visitors take advantage of this close proximity to visit the Mission San Luis Obispo de Tolosa, Farmer’s Market, and charming downtown. Others venture a little further to visit Hearst Castle, visit the elephant seals, or travel to wine country.