However, it would be impossible to submit a FOIA request for a big data analysis conclusion, since there may be no way to form such a request. Big data analyses typically ask, "What are the important or interesting conclusions I can draw from these large data sets?" They don't request a particular piece of information. The best big data analytics tell you what information you should think is important, rather than expecting you to know what information is important ahead of time.
Analysis: Big Data Analytics Today Lets Businesses Play Moneyball
Government agencies, therefore, face two strategic big data challenges. First, they must avoid swamping relevant information with noise; second, they must let citizens request important information from the government without having to know ahead of time why that information is important. Furthermore, the larger the available data sets become, the greater these challenges will be.
Our government can talk about open data and open government all it want, but if it doesn't get big data solutions right, then we risk floundering in an ocean of irrelevant information. The Presidential Innovation Fellows have their work cut out for them.
Read more about data management in CIO's Data Management Drilldown.