The good and bad of storage benchmarking

SPC-1 and SPC-2 benchmarks are often quoted in press releases, but what good are they in real life?

In my post last week, I talked about new record-breaking SPC-1 performance benchmark results for TMS's new RamSan-630. Judging by the email response, that lead many of you to wonder exactly what the Storage Performance Council is and what makes those results any more interesting than other third-party storage benchmarks.

[Fave raves: 22 IT pros name their favorite products and Cleanup utilities: Can they speed up your PC?]

In a field as complex as enterprise storage, building testing mechanisms that accurately reflect real life and provide any real value to end-users is fantastically difficult. With such an incredibly wide range of enterprise storage workloads and products, it's impossible to build a benchmark that has any hope of resembling all of them.

That said, the testing mechanisms used by the SPC are among the best -- not only due to the thoroughness of the tests themselves, but because the documentation and auditing required to submit a public result is quite elaborate. In fact, the documentation is often more interesting to a prospective storage buyer than the performance results themselves.

Who is the SPC?

To continue reading, register here to become an Insider. You'll get free access to premium content from CIO, Computerworld, CSO, InfoWorld, and Network World. See more Insider content or sign in.

This story, "The good and bad of storage benchmarking" was originally published by InfoWorld.

What’s wrong? The new clean desk test
Join the discussion
Be the first to comment on this article. Our Commenting Policies