A bad survey won’t tell you it’s bad. It’s actually really hard to find out that a bad survey is bad — or to tell whether you have written a good or bad set of questions. […]
Most seductively, surveys yield responses that are easy to count and counting things feels so certain and objective and truthful.
Even if you are counting lies.
Surveys are usually the easiest way to gather “relevant” user feedback, but it’s easy to see how they can be used to cop out of really listening to your users.
Not saying surveys are now forever banned as good practices of user research, but when Erika Hall is saying stuff like this, you tread carefully at the very least.