Nvidia estimates to be able to run processors at a mild 2.5GHz frequency on a 10nm high-performance node, or 2GHz in the low-power version, and is aiming at 4x power savings over current 40nm designs.
Nvidia’s preferred foundry partner’s TSMC has previously announced that 10nm would be possible in the 2017/2018 time frame.
They describe what is needed to get to 2 petaflops per cabinet and using 38 kilowatts. They outline 500 cabinets deliver an exaflop and using 19 megawatts.
If you liked this article, please give it a quick review on ycombinator or StumbleUpon. Thanks