I did the same with the crushed stone and put cobblestones, no problems after that. Neighbors were getting tired too of hearing stones flying by at 90 mph while I cut the grass.
Insanity is a long and winding road ... I think I finally made it there.