On the north shore of LI where I mainly fish, we have loads of small fish on 3 inch sandeels. Have to weed through dozens of dinks just to get a keeper sized fish

. Even the bigger are keyed on the small bait. Because you have large bait, you're not seeing the smaller fish, which can't eat them. I'm sure if you found some smaller bait, you'll find some smaller fish

.