Is too much data a problem for big data?


In response to an EFF lawsuit and subsequent requests for specific data, the NSA says that it can’t stop deleted the data it is wanted in the court case because it claims it’s systems are so complex. Clearly the NSA is dealing with a lot more data than most, if not all, companies, but is the pure complexity and volume of big data its Achilles’ heel?

Tags: big data, EFF, NSA
Topic: Big Data
Answer this Question


2 total
Vote Up (7)

That’s the challenge of big data - taking a massive amount of data and applying analytics to extract useful, actionable information. Keep in mind, I’m not a data scientist, but analysts sometimes refer to the “Three Vs of Big Data”:  data volume, data velocity and data type variety. Obviously volume is one of these and is consider a critical component of data analytics. Of course, the greater the variety and volume, the more challenging it can be to work with it. 


With respect to the NSA, I’m not buying it. They have a history of not being honest, even when the director is testifying to congress. They also have a history of denying that things are possible, only to have it come out later that not only was it possible, they were actually doing it. Things like intercepting Google’s network traffic comes to mind, for an example. I firmly suspect they are destroying the data that is requested because they don’t want to provide it, not because they lack the technological know-how to do so. Keep in mind that just a week or two ago, in response to an ACLU request to a Florida police department about cell phone spying, just before the records were to be produced, the US Marshal Service deputized one of the local police officers as a “special deputy marshal” then used that as a basis to claim that all records were property of the federal government and removed the records from the jurisdiction.

Vote Up (4)

You may find some of these TED Talks interesting:

Playlist: Making sense of too much data

Ask a question

Join Now or Sign In to ask a question.
The latest rankings of programming languages show a landscape that’s increasingly fragmented, but still dominated by the old guard
Select the mix of skills right for your data analytics business goals.
With the help of HP's Vertica Analytics Platform, Conservation International is crunching data from images to monitor the biodiversity of tropical forests around the world.
Data analysis software vendor Tableau is developing a new iPad app that might solve one of the problems the company faces with expanding its reach.
A new study shows that visual speech patterns could be the basis for a more secure method of verifying our identities online
Google is building its own shopping empire by pulling together several services and its massive amount of data.
A new study of open source project growth suggests that choosing a permissive license can help your community to grow faster
A new analysis of Reddit comments shows which language’s developers seem to be the happiest - and which are the most foul-mouthed
In the wake of recent security breaches of medical databases, doctors can’t be too careful
Analytics 3.0 will go beyond internal use and become a driver of external products and services.