For years these cloud warehouses were not held back by NAND, SSD, or HHD hardware issues. The hard part was the scalability and manageability of crushing amounts of data. Traditional hierarchic files systems were never intended to store hundreds of millions and billions of files in a single namespace. This old network file system (NFS) architecture forced data to be stored in multiple file systems, sometimes in multiple locations, and in complex directory structures.
Enter object storage, a relatively new way of storing data that organizes it into objects. Each object is made up of bytes, but also includes metadata describing the object. This allows data to be stored more efficiently and organized by metadata for easier retrieval.
Next up, the Storage Networking Industry Association is proposing a new standard called Cloud Data Management Interface. CDMI is a set of protocols defining how companies can safely move data between private and public clouds. The standard is open, allowing for wide adoption and the opportunity to associate more defined rules around object storage data, such as how long data should be retained, how many copies should be kept, and whether those copies need to be distributed geographically.
Enterprise Strategy Group's McClure says CDMI is a driving factor for making business more comfortable about moving data from backroom servers to the cloud. Twenty-two percent of the companies it surveyed that already store data in the cloud said that in the next three years they would move 90 to 100% of their data to the cloud.
While it's a given that storage will continue to drop in terms of price per gigabyte, how fast and how far are always the questions. It's impossible to factor in events such as the 2011 floods in Thailand that halted some manufacturing and significantly raised hard-drive prices. However, as bad as the floods were for the people of Thailand, they had a sobering effect on the hard-drive industry--a time-out as it were. Hard-drive prices have again dropped, but not quite back to pre-flood levels, and they are not in the free fall that they had been in.
According to Gartner analysts John Monroe and Joseph Unsworth, there is "a widespread and ongoing readiness at the executive level to curtail production at any moment..." and "the HDD sector intends to closely and continuously align production with evolving demand..." After the NAND price free fall in the first two quarters of 2012, a similar resolve seems to be developing in that industry. That, however, can change in any competitive market at the drop of a hat.