NVIDIA TensorRT 3 Dramatically Accelerates AI Inference for Hyperscale Data Centers

Alibaba, Baidu, Tencent, JD.com and Hikvision Adopt NVIDIA TensorRT for Programmable Inference Acceleration

About NVIDIA
NVIDIA's (NASDAQ: NVDA) invention of the GPU iNVIDIA's (NASDAQ: NVDA) invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI -- the next era of computing -- with the GPU acting as the brain of computers, robots and self-driving cars that can perceive and understand the world. More information at http://nvidianews.nvidia.com/.

(1) Performance comparison based on ResNet-50 on NVIDIA Tesla V100 GPU running TensorRT 3 RC vs. Intel Xeon-D 1587 Broadwell-E CPU and Intel DL SDK. Score doubled to comprehend Intel's stated claim of 2x performance improvement on Skylake with AVX512.

(2) Comparison based on cost and ResNet-50 inference performance of an HGX-1 server with 8x NVIDIA Tesla V100, and estimated cost and ResNet-50 performance of a dual socket Intel Skylake scale-out server. Skylake performance estimation comprehends Intel's stated claim of 2x performance improvement on Skylake with AVX512.

Certain statements in this press release including, but not limited to, statements as to: the benefits, impact and performance of NVIDIA TensorRT 3 AI inferencing software, NVDLA, NVIDIA DeepStream SDK, CUDA 9, Volta, Tesla GPU accelerators; and the demands for AI computing growing every day are forward-looking statements that are subject to risks and uncertainties that could cause results to be materially different than expectations. Important factors that could cause actual results to differ materially include: global economic conditions; our reliance on third parties to manufacture, assemble, package and test our products; the impact of technological development and competition; development of new products and technologies or enhancements to our existing product and technologies; market acceptance of our products or our partners' products; design, manufacturing or software defects; changes in consumer preferences or demands; changes in industry standards and interfaces; unexpected loss of performance of our products or technologies when integrated into systems; as well as other factors detailed from time to time in the reports NVIDIA files with the Securities and Exchange Commission, or SEC, including its Form 10-Q for the fiscal period ended July 30, 2017. Copies of reports filed with the SEC are posted on the company's website and are available from NVIDIA without charge. These forward-looking statements are not guarantees of future performance and speak only as of the date hereof, and, except as required by law, NVIDIA disclaims any obligation to update these forward-looking statements to reflect future events or circumstances.

© 2017 NVIDIA Corporation. All rights reserved. NVIDIA, the NVIDIA logo, CUDA, DGX, TensorRT and Tesla are trademarks and/or registered trademarks of NVIDIA Corporation in the U.S. and other countries. Other company and product names may be trademarks of the respective companies with which they are associated. Features, pricing, availability and specifications are subject to change without notice.

About NVIDIA
NVIDIA's (NASDAQ: NVDA) invention of the GPU iNVIDIA's (NASDAQ: NVDA) invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI -- the next era of computing -- with the GPU acting as the brain of computers, robots and self-driving cars that can perceive and understand the world. More information at http://nvidianews.nvidia.com/.

(1) Performance comparison based on ResNet-50 on NVIDIA Tesla V100 GPU running TensorRT 3 RC vs. Intel Xeon-D 1587 Broadwell-E CPU and Intel DL SDK. Score doubled to comprehend Intel's stated claim of 2x performance improvement on Skylake with AVX512.

(2) Comparison based on cost and ResNet-50 inference performance of an HGX-1 server with 8x NVIDIA Tesla V100, and estimated cost and ResNet-50 performance of a dual socket Intel Skylake scale-out server. Skylake performance estimation comprehends Intel's stated claim of 2x performance improvement on Skylake with AVX512.

Certain statements in this press release including, but not limited to, statements as to: the benefits, impact and performance of NVIDIA TensorRT 3 AI inferencing software, NVDLA, NVIDIA DeepStream SDK, CUDA 9, Volta, Tesla GPU accelerators; and the demands for AI computing growing every day are forward-looking statements that are subject to risks and uncertainties that could cause results to be materially different than expectations. Important factors that could cause actual results to differ materially include: global economic conditions; our reliance on third parties to manufacture, assemble, package and test our products; the impact of technological development and competition; development of new products and technologies or enhancements to our existing product and technologies; market acceptance of our products or our partners' products; design, manufacturing or software defects; changes in consumer preferences or demands; changes in industry standards and interfaces; unexpected loss of performance of our products or technologies when integrated into systems; as well as other factors detailed from time to time in the reports NVIDIA files with the Securities and Exchange Commission, or SEC, including its Form 10-Q for the fiscal period ended July 30, 2017. Copies of reports filed with the SEC are posted on the company's website and are available from NVIDIA without charge. These forward-looking statements are not guarantees of future performance and speak only as of the date hereof, and, except as required by law, NVIDIA disclaims any obligation to update these forward-looking statements to reflect future events or circumstances.

© 2017 NVIDIA Corporation. All rights reserved. NVIDIA, the NVIDIA logo, CUDA, DGX, TensorRT and Tesla are trademarks and/or registered trademarks of NVIDIA Corporation in the U.S. and other countries. Other company and product names may be trademarks of the respective companies with which they are associated. Features, pricing, availability and specifications are subject to change without notice.

Media Contacts

Global contacts for media inquiries.

All Contacts

Stay Informed

Newsroom updates delivered to your inbox.

Subscribe