I use two totally different bags (sets of inserts actually) for my day & night fishing...   Very few plugs/ lures are in both!  Even my bucktails & rinds are different!   
I'm 90% nocturnal from shore...   but in Fall esp. (and early Spring) I'll fish the "right" days!  Have had lots of high 20's/ low 30's Bass in daylight--   but like Paul all of my surf Large(r) came at night!