How Linux mastered Wall Street

Linux has become a dominant player in finance due to the OS kernel's ability to pass messages very quickly

By Joab Jackson, IDG News Service |  Software, Linux 5 comments

flckr/tripp-

When it comes to the fast-moving business of trading stocks, bonds and derivatives, the world's financial exchanges are finding an ally in Linux, at least according to one Linux kernel developer working in that industry.

This week, at the annual LinuxCon conference in Vancouver, Linux kernel contributor Christoph Lameter will discuss how Linux became widely adopted by financial exchanges, those high-speed computerized trading posts for stocks, bonds, derivatives and other financial instruments.

[Longterm kernel proposal signals ongoing Linux growth and Linux First Steps]

As an alternative to traditional Unix, Linux has become a dominant player in finance, thanks to the operating-system kernel's ability to pass messages very quickly, Lameter said in an interview with IDG. In fact, the emerging field of high-frequency trading (HFT) would not be possible without the open-source operating system, he argued. Lameter himself was hired as a consultant by one exchange -- he won't say which one -- based on his work in assembling large-scale Linux clusters.

Linux beats Windows (in this case)
At the Fortune 100 financial I was at, Windows was considered a joke. Even the local head of the Windows team admitted that the Unix side was where things were really happening. It was just more flexible, focused on high availability and so on. With Linux coming in so much on the Unix side, that flexibility has only increased. I'm sure whatever RHEL or SUSE edition being run on most servers is so heavily modified internally by the various companies internal engineering teams, that it doesn't look like a RHEL or SUSE anyone here has ever seen. And RHEL and SUSE bend over backwards to get the business -- which can be on tens of thousands, even hundreds of thousands of machines around the world.

Slashdot user br00tus | What's your take?

The largest exchange, the New York Stock Exchange (NYSE) Euronext, is run on a Linux system that can generate 1,500,000 quotes and process 250,000 orders every second, offering acknowledgments of each transaction within two milliseconds.

As late as 2007, Wall Street exchanges were still largely run on Unix, such as Hewlett-Packard's HP-UX, IBM's AIX and Sun Microsystems' Solaris.

"The release cycles with Solaris and AIX were very long -- two to three years between updates. Linux was able [to make the changes needed] within a month or so," Lameter said.

Financial exchanges need their servers to execute trades as quickly as possible. Even an edge of a few milliseconds could, over the course of trading billions of dollars a day, provide a competitive edge. This intensity created a hotbed of innovation that couldn't be easily encapsulated within multiyear release cycles, Lameter explained.

"The trading shops saw that the lowest-latency solutions would only be possible with Linux," Lameter said. "The older Unixes couldn't move as fast as Linux did."

One key attribute was the TCP/IP stack, the configuration of which determines how fast a message can be passed between two systems. Another appealing attribute has been a revamped scheduler, which ensures that a process -- one performing a trade for example -- isn't interrupted once it has been started. Lastly, thanks to an army of volunteer developers, Linux was able to offer drivers for new hardware more quickly than the large Unix vendors.

Linux also offered financial firms the ability to modify the source code to further speed performance, Lameter said. "It depends on how daring the exchange is," Lameter said, noting that NASDAQ uses a modified version of the Gentoo Linux distribution.

5 comments

    HP's version of Unix is HP/UX, AIX is IBM's version of Unix, usually running on POWER-based servers.
    aergern_tw8908262 27 weeks ago
    Yes, over all Windows might have 74.7% of the servers world wide but when they count print servers and other such low level functions can that really be taken seriously? I think not.
    aergern_tw8908262 26 weeks ago in reply to aergern_tw8908262
    Yes, I know they take those print servers seriously but I don't. I don't think counting a print server in the same class as a CentOS server with 15 VM based webservers running is the same at all ... just can't count those as no licenses have been sold. :)
    RizzoRocco_YahXOVD2Z 27 weeks ago in reply to aergern_tw8908262
    Microsoft takes those print servers seriously. They charge the same licensing fees for a file server, domain server, and print server, though they could feasibly be rolled into one server.

      Add a comment

      Post a comment using one of these accounts
      Or join now
      At least 6 characters

      Note: Comment will appear soon after you have activated your account.
      Obscene/spam comments will be removed and accounts suspended.
      The information you submit is subject to our Privacy Policy and Terms of Service.

      ITworld LIVE

      SoftwareWhite Papers & Webcasts

      White Paper

      Best Practices Guide: Microsoft Exchange 2010 on VMware

      This guide provides best practice guidelines for deploying Exchange Server 2010 on vSphere.

      White Paper

      Free Trial: vRanger, the Powerful VMware Recovery Solution

      When disaster strikes, don't waste hours and dollars recovering critical data. vRanger delivers blazing-fast speed and granular recovery for your VMware applications and data. Get your free trial today.

      White Paper

      Executive Guide to Business and Software Requirements

      This paper is designed as an executive briefing on the issues surrounding business and software requirements. It features a wealth of statistics and tactics to help you get requirements right, and includes a tear-out single page summary.

      White Paper

      How to Launch a Successful IT Automation Initiative

      Corporations across all industries are under increasing pressure to cut costs and work more efficiently. In the race to meet both of these requirements, many organizations turn to technology, often purchasing and installing disparate pieces of software in hopes of achieving efficiencies not afforded by manual systems.

      White Paper

      Why Corporations Need to Automate IT Systems Management

      With corporate budgets being slashed and leaders expecting more out of their employees, companies are forced to do more with less, yet are still expected to provide the highest quality experience to customers. This is pushing them to make better use of their IT assets without breaking the budget. Companies are under more pressure than ever, thanks to data management regulations; increasingly complex security threats; and growing demand from management and end users for 24/7 uptime and high performance. These hurdles require a strategic investment in technologies that boost efficiency, save money and position IT as an integral part of the entire firm's operations. IT systems management is helping corporations fill these gaps.

      See more White Papers | Webcasts

      Ask a question

      Ask a Question