I understand the premise, but that's not how polls work. Polls don't ask people "to say how they think". A poll is a telephone survey, the questions are succinctly worded and to the point, with straightforward closed-end answer choices. There is no "tell me what you think" aspect to it.
The problem with the polls were 1) they didn't conduct enough of them in states where they foolishly presumed she would win, like WI. and 2) the recency of polls after the Comey letter to Congress. Looking at the elections results vs. the polls, by throwing out any polls before the Comey letter and reviewing the remaining results, that data does a much better job of predicting the Trump outcome then just aggregating every poll, which is the trap Silver fell in.