Benchmarking with TensorRT-LLM

Evaluating the speed of GeForce RTX 40-Series GPUs using NVIDIA’s TensorRT-LLM tool for benchmarking GPU inference performance.

NVIDIA DIGITS with Caffe – Performance on Pascal multi-GPU

NVIDIA’s Pascal GPU’s have twice the computational performance of the last generation. A great use for this compute capability is for training deep neural networks. We have tested NVIDIA DIGITS 4 with Caffe on 1 to 4 Titan X and GTX 1070 cards. Training was for classification of a million image data set from ImageNet. Read on to see how it went.

Install Ubuntu 16.04 or 14.04 and CUDA 8 and 7.5 for NVIDIA Pascal GPU

You got your new wonderful NVIDIA Pascal GPU … maybe a GTX 1080, 1070, or Titan X(P) … And, you want to setup a CUDA environment for some dev work or maybe try some “machine learning” code with your new card. What are you going to do? At the time of this writing CUDA 8 is still in RC and the deb and rpm packages have drivers that don’t work with Pascal. I’ll walk through the tricks you need to do a manual setup of CUDA 7.5 and 8.0 on top of Ubuntu 16.04 or 14.04 that will work with the new Pascal based GPU’s

NVIDIA Titan GPUs (3 generations) – CUDA 8 rc performance on Ubuntu 16.04

I have a Titan Black, Titan X (Maxwell) and a new Titan X (Pascal) in a system for a quick CUDA performance test. Install is on Ubuntu 16.04 with CUDA 8.0rc. We’ll look at nbody from the CUDA samples code and NAMD Molecular Dynamics. It is stunning to see how much the CUDA performance has increased on these wonderful GPU’s in just 3 years.