The lights don't bother the fish one bit, especially if you're jigging. And when plugging, as stiffy mentioned, they can actually help. Shadow lines are natural ambush points. And FWIW, the white lights make better shadows than the yellow ones
Knowing the bottom structure and when a spot produces on what stage of the tide are much more crucial.