Is too much data a problem for big data?


In response to an EFF lawsuit and subsequent requests for specific data, the NSA says that it can’t stop deleted the data it is wanted in the court case because it claims it’s systems are so complex. Clearly the NSA is dealing with a lot more data than most, if not all, companies, but is the pure complexity and volume of big data its Achilles’ heel?

Tags: big data, EFF, NSA
Topic: Big Data
Answer this Question


2 total
Vote Up (6)

That’s the challenge of big data - taking a massive amount of data and applying analytics to extract useful, actionable information. Keep in mind, I’m not a data scientist, but analysts sometimes refer to the “Three Vs of Big Data”:  data volume, data velocity and data type variety. Obviously volume is one of these and is consider a critical component of data analytics. Of course, the greater the variety and volume, the more challenging it can be to work with it. 


With respect to the NSA, I’m not buying it. They have a history of not being honest, even when the director is testifying to congress. They also have a history of denying that things are possible, only to have it come out later that not only was it possible, they were actually doing it. Things like intercepting Google’s network traffic comes to mind, for an example. I firmly suspect they are destroying the data that is requested because they don’t want to provide it, not because they lack the technological know-how to do so. Keep in mind that just a week or two ago, in response to an ACLU request to a Florida police department about cell phone spying, just before the records were to be produced, the US Marshal Service deputized one of the local police officers as a “special deputy marshal” then used that as a basis to claim that all records were property of the federal government and removed the records from the jurisdiction.

Vote Up (4)

You may find some of these TED Talks interesting:

Playlist: Making sense of too much data

Ask a question

Join Now or Sign In to ask a question.
A new analysis of Reddit comments shows which language’s developers seem to be the happiest - and which are the most foul-mouthed
In the wake of recent security breaches of medical databases, doctors can’t be too careful
Analytics 3.0 will go beyond internal use and become a driver of external products and services.
Many executives and organizations see big data as a panacea, but data and analytics can't address every problem you face.
A new study reveals that Java developers make the most while JavaScript programmers are the most wanted
Adatao is another startup promising easier data analytics for the masses. It stands out in a few ways.
New data from AngelList shows the top technology choices that startups are making
Aiming to expand its operational intelligence capabilities, Splunk today unveiled Splunk App for Stream, which the company says is a free addition to Splunk Enterprise and Splunk Cloud that makes it easy to capture wire data and combine it with the machine-generated data Splunk already captures and analyzes.
NomadList uses crowdsourced data to show which cities in the U.S. and the world are the best - and worst - for remote workers
Viewing the data center as the focal point of an ambitious set of technology initiatives, federal CIOs are working aggressively to slash server counts and consolidate facilities as they position their agencies to adopt cloud applications, roll out mobile technologies and support big data projects.
Join us: