How do you evaluate SaaS performance?

SilverHawk

Like most companies, we have increasingly turned to the Cloud, both for storage and SaaS. Overall, this has been beneficial. Costs are generally down, and reliability is as good or better as it was prior to embracing the cloud. The one area that I have misgivings is SaaS. When everything works it is great, and to be fair, that is usually the case. But not always. In the past, I could use an application management system to keep track of performance and resources, and I could often head off problems before they became an issue. That's essentially out of my hands now. How can I monitor SaaS applications and evaluate performance now that everything is physically out of my hands?

Answer this Question

Answers

3 total
Vote Up (3)

The internet is a key issue when evaluating SaaS or cloud providers. RIght now ThousandEyes has the ability to monitor and disagnos the issues the this unknow can create. I know you posted this a few months ago, but I can send you a link for a free trial of the software.

 

-Chris

christopher@thousandeyes.com

 

jimlynch
Vote Up (10)

Here's an article that provides five key things to evaluate a SaaS vendor. It might be useful if you apply these items in a performance review of a vendor you are currently using.

How to Evaluate SaaS Vendors: Five Key Considerations
http://sandhill.com/article/how-to-evaluate-saas-vendors-five-key-consid...

1. Disaster Recovery
2. Security
3. Flexiblity and Quality of Service
4. SLAs
5. Global Reach

lbloom
Vote Up (11)

I use CA's APM Cloud Monitor, which is helpful.  But there is a monkey wrench thrown into evaluation of SaaS performance - the internet.  It is often challenging to determine whether my SaaS provider is the one responsible for an unresponsive application, or if it is "the internet".  Want to venture a guess at which one gets the blame every single time that I have contacted my provider?  If you guessed they said, "our bad, we'll take care of it," I have a bridge that I'd like to sell you.  They are probably right a lot of the time, but it isn't as if I can't ping/traceroute and get an idea of network performance.  It's a lot harder to measure performance inside of the provider's infrastructure, and let's be honest, if I was them I wouldn't let everyone past my firewall either.  Still, I think we have a little way to go to find the balance between provider security and user control/access. 

Ask a question

Join Now or Sign In to ask a question.
Salesforce.com is to acquire Clipboard, a Web clipping and sharing service, and is closing down the service.
Box has acquired Crocodoc in a move to significantly improve the way documents are rendered for viewing on its enterprise storage and file sharing service.
With the backing of its new parent company, Yammer more than tripled its revenue year on year in the quarter that ended in March.
Dell has purchased Enstratius, a company that allows customers to manage cloud resources across multiple providers from a single management console, for an undisclosed sum this week.
OnApp and Dell have teamed up to create pretested cloud packages for service providers and make it easier for them to roll out services, which could result in more competition in the cloud space.
Google is rolling out a new IT administration console for its Apps email and collaboration cloud suite and for other enterprise products such as Maps Coordinate and Chrome OS devices.
Airport's IT transformation to cloud, BYOD support is saving money, boosting security.
Cloud-based infrastructure and software providers like Amazon and Salesforce are incorporating application development tools into their offerings, blurring the lines between IaaS, SaaS and PaaS
Google has added a new notification to its Cloud Storage service, allowing applications to automatically take action when new content is uploaded by users.
If comparing Bing and Google on regular search results isn’t enough, try comparing them based on autocomplete suggestions
Join us:
Facebook

Twitter

Pinterest

Tumblr

LinkedIn

Google+