The Volta design draws from the idea of 3D stacking, in which chips are stacked on top of each other to reduce the size of a processor.
Nvidia in the past was criticized for its Fermi GPU architecture, which was considered too power hungry. However, Nvidia solved some of Fermi's problems with Kepler, and hopes for the future chips to be faster and more power efficient.
Nvidia also showed a computer called Kayla. which Huang called the world's fastest ARM computer.
Based on Tegra 3 processors, Nvidia said it created a new low-power GPU and combined it with ARM processors to create the computer.
Kayla brings the computing power and GeForce and Tesla to one computer, Huang said. Nvidia said the computer is capable of doing real-time ray tracing, which generates accurate images by tracing paths of light. In addition, the computer also supports CUDA 5, OpenGL and also PhysX.
This was not the first time that Nvidia's Tegra 3 chip is being used for supercomputing. The Barcelona Supercomputing Center in 2011 built a supercomputer using quad-core Tegra 3 processors.