As mentioned in Big Data, Big Moves (August 2011) data compression and data deduplication solutions are often used to eliminate redundant files and reduce required storage space.
Organisations also reported that end-users and decision makers demand the ability to control the data analysis process through self-service tools, removing the burden of delivering reports from the IT department, and allowing for employees to quickly and easily obtain answers from the data precisely when they need it.
Much of the excitement surrounding Big Data, focuses on the new technologies, currently available or being developed, to specifically manage and analyze massive, varied data sets.
To determine which of these powerful new tools provides the most value, the CIO must help the enterprise identify current needs and articulate a long-term vision for the next evolution of their products or services.
Solutions now exist to process massive amounts of data in real-time, to search and analyze any type of unstructured or semi-structured data, and deliver this information to anyone, almost anywhere.
Aberdeen's research shows that there are several major technological categories with incredible growth potential that CIOs should monitor, and determine if they can enhance their business (see Figure 2).
Organisations needing to accelerate their data-centric tasks, or quickly deliver intelligence, are reporting significant interest in the processing speed provided by in-memory technology, which Aberdeen's research has shown to be over 100-times faster than traditional tools.
Real-time integration is a complementary technology, allowing data sets to be updated with current information faster than traditional batch integration.
Getting this information into the hands of the right people is the last step in the process, and in this age of the smartphone, companies can now supply their remote or traveling workforce with BI capabilities through mobile apps and technology.
The future of Big Data is wide open and the possibilities are tantalising.
New insights gleaned from data never before combined, and delivered faster to more users than ever before, represents only the tip of the iceberg.
The role of the CIO in this new information revolution has never been more important, as it is their responsibility to manage the complex task of determining how Big Data can benefit their company, identifying untapped data sources, and selecting the technologies that are the best fit for the needs and goals of the enterprise.
Nathaniel Rowe is research analyst, enterprise data management for Aberdeen Group