In a separate interview with IDG News Service, Yahoo CTO Raymie Stata pointed out that Hadoop could reduce the need for building supercomputers to analyze large data sets. Traditionally, large data sets have been moved from storage into the supercomputer, which is a pooled set of servers, to be analyzed. In contrast, Hadoop moves the analytic computation to where the data resides, eliminating the need for a cental, giant number-crunching machine. Yahoo was an early leading contributor to Hadoop.
In addition to Cloudera's offering, Hadoop is also being commercialized by IBM, which recently started offering a set of analytic services that use the technology.