A lot depends on the wind. I would say most of South Beach will have a big ground swell no matter how hard it blows. Squibby, too, all the way around to Gay Head. You probably won't be able to get to most of Pogue via the beach due to flooding. Whether you can get to Chappy via the ferry depends on how high the tide in Edgartown Habbah rises. I've been there during noreasters where the municipal wharf was under water. NE winds mean big waves, but Gay Head is still fishable so long as the water isn't tea colored from clay run-off. You might find cleaner water by walking south from Philbin's towards Zack's Long Beach and Squib.
There are still fishable spots no matter how hard it blows

An island always has a lee side in any weather.
For many years, the Grand Prize went to the largest bass caught, period. As it happened it was usually a shore fish----guys like #^^^^& Hathaway, Sergey de Somov, Ralph Grant, Stevie Morris, etc. Then they started separate Shore and Boat categories, and the largest bass from each won. When they took bass out of the Derby in the 80s, they made the other species eligible for the Grand Prize. The guys with the biggest fish of each eligible species, from shore and from boat, would each pick a key out of a hat and try to open a padlock. Only one key would work, and that key won the Grand Prize. When they put bass back in around 1992 or so, they weren't eligible for the Grand Prize the first couple of years. Now, I believe they have separate Grand Prizes for Boat and Shore, and it's the 4 people in the shore, and the 4 people in the boat, with the biggest fish of each eligible species who compete against each other. Assuming albies are still eligible for the Grand (haven't entered in a few years).