Do The CCIE Test Questions Need An Overhaul

October 8, 2008, 11:30 AM — 

I did a blog post in May 2008 with a suggestion to Cisco about their test question database. I had just passed my CCIE recertification written test and had used the preparation tools offered by NetMaster Class (Bruce Caslow, #3139 and Val Pavlichenko, #3765). I continued to see a high incidence of repeat questions on the Cisco written test. My rough guess was that the test database was about 400 questions, which was verified by someone at Cisco. This small database makes it easy for brain-dump organizations to track question changes and to have a market for their offerings.

My suggestion is to increase the question database to over 1000 questions. I think that's a low number. Even better would be a test database of over 2000 questions or perhaps even 3000 questions. Why not allow the people in the industry to submit questions (and maybe even answers) to Cisco to help populate the test database? Guidelines could be published and Cisco would then only have to validate the questions and answers prior to including them in the test database.

With that quantity of questions, memorizing the test questions and answers becomes much more difficult. You really have to understand the technology and be able to properly answer the questions. Interestingly, one of the folks at Netcordia was just going through airplane pilot and commercial rating training. He said that the FAA database is approximately 1000 questions and that they are required to publish the questions and answers. While it is possible to nearly memorize (for most of us) all 1000 questions, I was curious if that large a corpus would help someone better understand the topic. When I asked this person about whether it helped or hindered his understanding of the topic, he indicated that it helped. Training companies could then cover the technology in ways that facilitate answering the test questions (I'm not suggesting teaching to the test – teach the technology thoroughly enough to allow someone to successfully pass the test).

Cisco could contract with a few of the training companies to generate questions and answers. Each contractor could generate 100 or 200 questions and only have visibility into a portion of the full database. These people could then participate in the certification themselves.

One of the problems I have with the current test database is that the Cisco employees who create the questions are having problems finding questions that test understanding of a technology. Once a good question is created, it doesn't take long for the brain-dump organizations to learn the question and publish the right answer. So the Cisco folks then engage in a game in which they try to come up with new questions. Unfortunately, there are only so many questions you can ask about a given topic before you've exhausted the set of good questions. The Cisco folks are then tempted to start asking questions about technology trivia.

Sign up for ITworld's Daily newsletter
Follow ITworld on Twitter @IT_world

I like it!
Close

On Twitter now

CCIE

Powered by Twitter
You are logged in | Sign out
Sign in and post to Twitter

What are you thinking?

Cancel Tweet sent

On Twitter now

Comments

Very right

i had to reappear in a written test, failed first time because of ill-prep, and jeese the questions were as exactly as the first try. I was wondering what to do with that so am not going to be labelled as a dumper!!!

i cannot understand why such a big company is doing such a little for such a big cert.

| reply

re. Do The CCIE Test Questions.....

Cisco needs to pay attention. I am also a CCIE of 10 + years. The R&S questions in the year 2000 recert test were directly related to design and protocol knowledge. Minutiae and subjectivity has crept into the exam over the years. Crafty, test question wordsmithing is executed by professionals for whom the test language is a second or third language. Sweating through ambiguous test questions is an experience that Cisco should be obliged to avoid on behalf of their CCIEs. Change the nature of the test, Cisco. It may cost a bit of money and time, but we CCIEs have all invested in your future, along with ours.
| reply
peer-to-peer

jfruh
Apple syncing patent can't come soon enough

pasmith
New Twitter features borrow from 3rd party clients

Esther Schindler
Open Source Changes the Software Acquisition Process

mikelgan
How to set up continuous podcast play on the new iTunes

David Strom
Five important Windows 7 mobility features

sjvn
Guard your Wi-Fi for your own sake                        

Sandra Henry-Stocker
Grepping on Whole Words

 

Sidekick: The Good News & the Bad News
Either way you look at it Microsoft Data Center management did not follow standards or best practices in this failure. In which case it makes me wonder more about the outsourcing of corporate data much less personal data.
- mburton325

Join the conversation here

The Daily Tip

The Daily TipQuick, practical advice for IT pros. Made fresh daily.

Hot tips:

Want to cash in on your IT savvy? Send your tip to tips@itworld.com. If we post it, we'll send you a $25 Amazon e-gift card.

Newsletters

Subscribe to ITWORLD TODAY and receive the latest IT news and analysis.

I would like to receive offers via email from ITworld partners.
By clicking submit you agree to the terms and conditions outlined in ITworld's privacy policy.
Featured Sponsor

AISO founders envisioned a Web hosting company that was environmentally friendly. While the company employed energy-efficient innovations like solar panels, its infrastructure produced unacceptable power and cooling requirements. Find out how AISO leveraged AMD technology to overcome their challenge in this case study white paper.

In this whitepaper, Scalar explores the opportunity to change the landscape with respect to mission critical databases built around Oracle. Leveraging technologies such as Linux, high-end commodity processing power and Oracle RAC technology to architect, design, build and maintain database infrastructure that delivers maximum availability, reliability and performance at a fraction of traditional cost.

On a typical day, weather.com, the Web site for The Weather Channel in Atlanta, serves up between 15 million and 20 million page views. But in September 2004, when back-to-back hurricanes ransacked Florida, the peak traffic on one day more than tripled: over 70 million page views by more than 7 million unique visitors. Read the full success story now.

Marketplace