Clay Shirky says welcome the Data Deluge, but improve your Data Filters
Clay Shirky thinks the problem is filters. That has been the pat answer for as long as there has been data. However, that is not the answer. The answer to accept all the data and analyze it through better visualization. It is better to change the granularity of data and see “the big picture” to see the trends, make a hypothesis, make predictions. We have to learn induction instead of continually resorting to deduction.
There is no bad data. There is a lot of bad analysis.