Catching up with LinkGuard

January 18, 2001, 11:48 AM —  Network World — 

When I first met with start-up LinkGuard at NetWorld+Interop last May in Las Vegas the company was setting out to rid the world of broken Web links.

I caught up with LinkGuard again at Interop in Atlanta a few weeks ago and, while the company is basically on track, it turns out the problem is even bigger than the founder first thought.

To refresh your memory, LinkGuard wants to offer a link integrity service based on a database of public Web links. Unlike products used to find broken links on a site, LinkGuard identifies broken inbound links.

That's important because inbound links can be a good source of traffic. If, for example, Cisco published a link to a Network World story and we subsequently moved that story, we would be shutting the door on potential readers.

If we were a LinkGuard customer, instead of returning a 404 error message to the cisco.com surfer, we would redirect the request to LinkGuard that would look up the proper location in its LinkMap database of public Internet links. Then LinkGuard would notify Cisco about the dead link or, if Cisco was a LinkGuard customer, go into cisco.com and fix the link.

Obviously the key to this is the LinkMap database. Company Founder and CEO Franck Jeannin started off thinking that the roughly two billion Web pages on the Internet probably had about 10 links per page. That meant he had to map 20 billion links, something he could achieve with an 8-terabyte database.

It turns out there are about 52 links per page, meaning he has to map about 100 billion links, a job that will require a 40-terabyte database.

While that sounds daunting, Jeannin says building the database will take crawlers about 10 days. What's taking the time is selecting vendor partners (Dell and Microsoft), hiring people, raising money and finalizing the software.

One interim advancement since last we talked: the ability to scan for bad JavaScript links. LinkGuard can now run the scripts like a browser and check the links generated.

LinkGuard has 500 companies using the software to test their own sites for broken links but won't make the inbound testing available until the database is completed in March.

An end to bad links may be on the horizon.

» posted by ITworld staff

Network World

I like it!
Post a comment
The content of this field is kept private and will not be shown publicly.
  • Allowed HTML tags: <a> <em> <strong> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd>
  • Lines and paragraphs break automatically.
Resources
White Paper

Symantec Backup Exec 12 and Backup Exec System Recovery 8 deliver industry leading Windows data protection and system recovery. Download this whitepaper to find out the top reasons to upgrade and how to get continuous data protection and complete system recovery.

Webcast

Data and system loss — from a hard drive failure, malicious attack, natural disaster, or simple human error — can happen anytime. Don’t leave your business vulnerable. Make sure you have a secure recovery strategy in place. Symantec's latest backup and system recovery technology can efficiently restore critical applications, individual emails and documents and even restore your entire system in minutes in the event of a loss.

White Paper

Businesses face a growing challenge to ensure that the IT environment is properly protected. Backup Exec 12 integrates with other applications in the Symantec family of products, to complement your current data protection strategy, keep your data securely backed up and make it recoverable when you need it most.

Free stuff

Enterprise 2.0 Implementation
By Aaron C. Newman, Jeremy Thomas
Published by McGraw-Hill
Learn more!

Deploying Cisco Wide Area Application Services
By Zach Seils, Joel Christner
Published by Cisco Press
Learn more!

Featured Sponsor

AISO founders envisioned a Web hosting company that was environmentally friendly. While the company employed energy-efficient innovations like solar panels, its infrastructure produced unacceptable power and cooling requirements. Find out how AISO leveraged AMD technology to overcome their challenge in this case study white paper.

In this whitepaper, Scalar explores the opportunity to change the landscape with respect to mission critical databases built around Oracle. Leveraging technologies such as Linux, high-end commodity processing power and Oracle RAC technology to architect, design, build and maintain database infrastructure that delivers maximum availability, reliability and performance at a fraction of traditional cost.

On a typical day, weather.com, the Web site for The Weather Channel in Atlanta, serves up between 15 million and 20 million page views. But in September 2004, when back-to-back hurricanes ransacked Florida, the peak traffic on one day more than tripled: over 70 million page views by more than 7 million unique visitors. Read the full success story now.

More Resources