March 21, 2012, 7:54 AM — Big Data is all the rage these days, and more than a few organizations are at least wondering what sort of business intelligence they could derive from all the information at their disposal. But while awareness of Big Data is growing, only a few organizations-like Google or Facebook-are really in position to capitalize on it now. However, the time is coming and organizations that expect to leverage Big Data will not only have to understand the intricacies of foundational technologies like Apache Hadoop, they'll need the infrastructure to help them make sense of the data and secure it.
In the next three to five years, we will see a widening gap between companies that understand and exploit Big Data and companies that are aware of it but don't know what to do about it, says Kaylan Viswanathan, global head of information management with Tata Consultancy Services' (TCS) global consulting group. The companies that succeed in turning Big Data into actionable information with have a clear competitive advantage, Viswanathan says.
"Today, most companies are aware of Big Data," he says. "There's a lot written about it. There are conferences about it. Awareness has become quite pervasive. But if you look at actually exploiting Big Data, I would say we're at the very beginning stages of it."
Viswanathan says he believes that Silicon Valley Internet-based businesses like Facebook and Googlewhere the entire business is based upon the management and exploitation of dataare leading the charge when it comes to Big Data. Industries like financial services won't be far behind, he says, and neither will the intelligence or military communities. Other verticals like retail, telecom, healthcare and manufacturing will follow.
"In terms of readiness to exploit Big Data relatively soon, I would say the companies have to be market leaders in their industry segments," he says. "They will be the ones that tend not to wait until others have exploited new technology. They would rather forge ahead and set the standard for their industry vertical."
The Role of Big Data
What role would Big Data play? Well, for instance, a pharmaceutical company might want to identify the top 100 opinion-makers in the pharmaceutical world. To do so, it could crawl the web and go to millions of pages related to the industry, ingesting the data while weeding out anything that's not related to the objective. Or an automobile manufacturer could collect instrumentation data live from its cars in real-time as they're driven on the road.
In many cases, says Larry Warnock, CEO of Big Data encryption and key management specialist Gazzang, we have not yet imagined the ways in which we will leverage Big Data.