One spot that I love to fish is great on the half-tide down. I great rip forms up next to a hole. However the surfers love the same thing. More than once I've been there rod in hand (sometimes with a bait stick in the surf too), and they'll surf right where I'm casting and think nothing of it. My fishing doesn't disrupt their surfing, but regrettably it doesn't work the other way around.
