Storage Tip: Mitigate pain of storage growth with active archiving, data deletion, and data de-duplication

November 28, 2007, 03:42 PM —  Mesabi Group — 

What seems to be the problem? Estimates of annual storage growth are 60% and
annual budget growth around 4-5%. While your storage growth may not be that
high, the growth rate of storage is still likely to exceed the annual overall
decline in storage prices. Can you afford it? This problem isn't new, nor is
it only about how to squeeze out enough dollars to pay the bill. It's also a
question of management. Throw in power and cooling requirements, and will you
be able to handle the extra environmental demands?

What you need to know: Unfortunately, the problem will likely continue for
years to come. Not only must you do things better; you must do different things, and that requires a transformation in how you go about doing the storage business.
Note that the pressure of storage growth is only one of the elements driving
that transformation, but it is still enough to get you started thinking about
the problem. (Previous storage tips have already touched upon some of the drivers
and future storage tips will continue to do so.)

Actions that you can take include active archiving, data deletion, and data
de-duplication.

Active archiving can be the repository for your fixed content data. Since this
is likely to be the bulk of your data, what you do with active archiving data
can have a significant impact. Let's see why. First, your active production
data becomes smaller with the burden of fixed content data being co-mingled
within it. Thus, there is less data to be backed up. Active archiving data does
not necessarily have to be backed up in the traditional sense. Rather it must
be replicated -- which is not backup -- and the number of replications is likely
to be less than the number of copies that can be found on backups. Second, active
archive data is typically stored on a different tier of storage than is active
production data. That tier of storage may well be SATA disks that are more cost-efficient
than the FC disks upon which active production data is typically housed. But
you save not only on the disks themselves, but also on power and cooling as
SATA disks are greener than FC disks. (They use about the same power, but store
more data so you can store more data for the same power requirements.) Finally,
active archives can be subject to data de-duplication techniques, such as single
instance storage. Moreover, apart from cost and green savings, an active archive
is essential for data retention management of your data.

Sign up for ITworld's Daily newsletter
Follow ITworld on Twitter @IT_world

I like it!
Post a comment
The content of this field is kept private and will not be shown publicly.
  • Allowed HTML tags: <a> <em> <strong> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd>
  • Lines and paragraphs break automatically.
peer-to-peer

jfruh
Apple syncing patent can't come soon enough

pasmith
New Twitter features borrow from 3rd party clients

Esther Schindler
Open Source Changes the Software Acquisition Process

mikelgan
How to set up continuous podcast play on the new iTunes

David Strom
Five important Windows 7 mobility features

sjvn
Guard your Wi-Fi for your own sake                        

Sandra Henry-Stocker
Grepping on Whole Words

 

Sidekick: The Good News & the Bad News
Either way you look at it Microsoft Data Center management did not follow standards or best practices in this failure. In which case it makes me wonder more about the outsourcing of corporate data much less personal data.
- mburton325

Join the conversation here

The Daily Tip

The Daily TipQuick, practical advice for IT pros. Made fresh daily.

Hot tips:

Want to cash in on your IT savvy? Send your tip to tips@itworld.com. If we post it, we'll send you a $25 Amazon e-gift card.

Newsletters

Subscribe to ITWORLD TODAY and receive the latest IT news and analysis.

I would like to receive offers via email from ITworld partners.
By clicking submit you agree to the terms and conditions outlined in ITworld's privacy policy.
Featured Sponsor

AISO founders envisioned a Web hosting company that was environmentally friendly. While the company employed energy-efficient innovations like solar panels, its infrastructure produced unacceptable power and cooling requirements. Find out how AISO leveraged AMD technology to overcome their challenge in this case study white paper.

In this whitepaper, Scalar explores the opportunity to change the landscape with respect to mission critical databases built around Oracle. Leveraging technologies such as Linux, high-end commodity processing power and Oracle RAC technology to architect, design, build and maintain database infrastructure that delivers maximum availability, reliability and performance at a fraction of traditional cost.

On a typical day, weather.com, the Web site for The Weather Channel in Atlanta, serves up between 15 million and 20 million page views. But in September 2004, when back-to-back hurricanes ransacked Florida, the peak traffic on one day more than tripled: over 70 million page views by more than 7 million unique visitors. Read the full success story now.

Marketplace