Josh Clark opens with “Our answer machines have an over-confidence problem." Perhaps you’ve seen the examples of search results (in any form) presenting terrifyingly wrong (or at least "controversial") "answers". Hash tag fake news.
Search, in whatever form we offer it to our users, tends that way. This our top result, dear person! Interact with it! Our algorithm predicts you won’t regret it! Certainly, there is incentive to present results in that way.
Josh asks some hard questions:
Systems Smart Enough To Know When They’re Not Smart Enough is a post from CSS-Tricks