Threadripper 3990x 64-core Parallel Scaling
Written on February 25, 2020 by Dr Donald Kinghorn64 cores is a lot of cores! How well will parallel applications scale on that many cores? The answer, of course, is, it depends on the application. In this post I look at Amdhal's Law parallel scaling for HPL Linpack, Python numpy and the NAMD molecular dynamics program.
Note: How To Install JupyterHub on a Local Server
Written on February 19, 2020 by Dr Donald KinghornThis note describes installing and configuring JupyterHub and JupyterLab on a "bare-metal" server.
AMD Threadripper 3990x 64-core Linpack and NAMD Performance (Linux)
Written on February 7, 2020 by Dr Donald Kinghorn64 cores! The latest AMD Threadripper is out, the 3990x 64-core. I've spent the last couple of days running benchmarks and have some results showing raw numerical compute performance using my standard CPU testing applications HPL Linpack and the molecular dynamics program NAMD. The 3990x is a great processor with exceptional performance. Especially for NAMD! (There were some difficulties and disappointments during the testing and I report those here too.)
Note: Auto-Install Ubuntu with Custom Preseed ISO
Written on January 30, 2020 by Dr Donald KinghornThis note describes creating an ISO image for a fully automatic, customized Ubuntu 18.04 server install.
Note: Setup Git for PowerShell on Windows 10
Written on January 24, 2020 by Dr Donald KinghornHow to setup PowerShell nicely for using git with command completion and color highlighted shell prompt git status/action notifications.
Notes on "Notes" (new blog post format)
Written on December 31, 2019 by Dr Donald KinghornStarting 2020 off with an addition to my writing, "micro blogging" via GitHub Gists
NVIDIA (Computing Hardware) Company of the Decade!
Written on December 13, 2019 by Dr Donald KinghornIt's the end of the 2010's and start of 2020's. Time to reflect ...
SC19 A look at the high end of HPC
Written on December 10, 2019 by Dr Donald KinghornThe Super Computing conference annual US counterpart is always a great meeting. It's a chance to see the trend and get sentiment for the highest performance end of computing. I have written up a few observations and provided a few interesting links for SC19.
How To Use MKL with AMD Ryzen and Threadripper CPU's (Effectively) for Python Numpy (And Other Applications)
Written on November 27, 2019 by Dr Donald KinghornIn this post I'm going to show you a simple way to significantly speedup Python numpy compute performance on AMD CPU's when using Anaconda Python.
AMD Threadripper 3970x Compute Performance Linpack and NAMD
Written on November 25, 2019 by Dr Donald KinghornAMD Threadripper 3970x 32-core! ...The, third new AMD processor I've had the pleasure of trying recently. I'm running it through the same double precision floating point performance tests as the recently tested Ryzen processors, Linpack and NAMD.
AMD Ryzen 3950x Compute Performance Linpack and NAMD
Written on November 14, 2019 by Dr Donald KinghornThe, much anticipated, AMD Ryzen 3950x 16-core processor is out! As always the first thing I wanted know was the double precision floating point performance. My two favorite applications for a "first look" at a new CPU are Linpack and NAMD.
Workstation Setup for Docker with the New NVIDIA Container Toolkit (nvidia-docker2 is deprecated)
Written on September 13, 2019 by Dr Donald KinghornIt's time for a "Docker with NVIDIA GPU support" update. This post will guide you through a useful Workstation setup (including User-name-spaces and performance tuning) with the new versions of Docker and the NVIDIA GPU container toolkit.
AMD Ryzen 3900X vs Intel Xeon 2175W Python numpy - MKL vs OpenBLAS
Written on August 20, 2019 by Dr Donald KinghornIn this post I've done more testing with Ryzen 3900X looking at the effect of BLAS libraries on a simple but computationally demanding problem with Python numpy. The results may surprise you! I start with a little bit of history of Intel vs AMD performance to give you what may be a new perspective on the issue.
2 x RTX2070 Super with NVLINK TensorFlow Performance Comparison
Written on August 14, 2019 by Dr Donald KinghornThis is a short post showing a performance comparison with the RTX2070 Super and several GPU configurations from recent testing. The comparison is with TensorFlow running a ResNet-50 and Big-LSTM benchmark.
AMD 3900X (Brief) Compute Performance Linpack and NAMD
Written on July 26, 2019 by Dr Donald KinghornI was able to spend a little time with an AMD Ryzen 3900X. Of course the first thing I wanted know was the double precision floating point performance. My two favorite applications for a "first look" at a new processor are Linpack and NAMD. The Ryzen 3900X is a pretty impressive processor!
NVIDIA Docker2 with OpenGL and X Display Output
Written on July 11, 2019 by Dr Donald KinghornDocker is a great Workstation tool. It is mostly used for command-line application or servers but, ... What if you want to run an application in a container, AND, use an X Window GUI with it? What if you are doing development work with CUDA and are including OpenGL graphic visualization along with it? You CAN do that!
Install TensorFlow 2 beta1 (GPU) on Windows 10 and Linux with Anaconda Python (no CUDA install needed)
Written on June 26, 2019 by Dr Donald KinghornTensorFlow 2.0.0-beta1 is available now and ready for testing. What if you want to try it but don't want to mess with doing an NVIDIA CUDA install on your system. The official TensorFlow install documentations has you do that, but it's really not necessary.
How To Run Remote Jupyter Notebooks with SSH on Windows 10
Written on June 11, 2019 by Dr Donald KinghornBeing able to run Jupyter Notebooks on remote systems adds tremendously to the versatility of your workflow. In this post I will show a simple way to do this by taking advantage of some nifty features of secure shell (ssh). What I'll do is mostly OS independent but I am putting an emphasis on Windows 10 since many people are not familiar with tools like ssh on that OS.
How To Use SSH Client and Server on Windows 10
Written on May 31, 2019 by Dr Donald KinghornThis post is a setup guide and introduction to ssh client and server on Windows 10. Microsoft has a native OpenSSH client AND server on Windows. They are standard (and in stable versions) on Windows 10 since the 1809 "October Update". This guide should helpful to both Windows and Linux users who want better interoperability.
How To Install Docker and NVIDIA-Docker on Ubuntu 19.04
Written on May 7, 2019 by Dr Donald KinghornBeing able to get Docker and the NVIDIA-Docker runtime working on Ubuntu 19.04 makes this new and (currently) mostly unsupported Linux distribution a lot more useful. In this post I'll go through the steps that I used to get everything working nicely.
How to Install TensorFlow with GPU Support on Windows 10 (Without Installing CUDA) UPDATED!
Written on April 26, 2019 by Dr Donald KinghornThis post is the needed update to a post I wrote nearly a year ago (June 2018) with essentially the same title. This time I have presented more details in an effort to prevent many of the "gotchas" that some people had with the old guide. This is a detailed guide for getting the latest TensorFlow working with GPU acceleration without needing to do a CUDA install.
How To Install CUDA 10.1 on Ubuntu 19.04
Written on April 5, 2019 by Dr Donald KinghornUbuntu 19.04 will be released soon so I decided to see if CUDA 10.1 could be installed on it. Yes, it can and it seems to work fine. In this post I walk through the install and show that docker and nvidia-docker also work. I ran TensorFlow 2.0- alpha on Ubuntu 19.04 beta.
TensorFlow Performance with 1-4 GPUs -- RTX Titan, 2080Ti, 2080, 2070, GTX 1660Ti, 1070, 1080Ti, and Titan V
Written on March 14, 2019 by Dr Donald KinghornI have updated my TensorFlow performance testing. This post contains up-to-date versions of all of my testing software and includes results for 1 to 4 RTX and GTX GPU's. It gives a good comparative overview of most of the GPU's that are useful in a workstation intended for machine learning and AI development work.
Intel Xeon W-3175X and i9 9990XE Linpack and NAMD on Ubuntu 18.04
Written on February 28, 2019 by Dr Donald KinghornThere are 2 recent Intel processors that are really strange, the Xeon W-3175X 28-core, and the Core i9 9990XE overclocked 14-core. I was able to get a little time in on the these processors. I ran a couple of numerical compute performance tests with the Intel MKL Linpack benchmark and NAMD. I used the same system image that I had used recently to look at 3 Intel 8-core processors so I will include those results here as well. **There will be results for W-3175, 9990XE, 9800X, W-2145, and 9900K**.
RTX Titan TensorFlow performance with 1-2 GPUs (Comparison with GTX 1080Ti, RTX 2070, 2080, 2080Ti, and Titan V)
Written on January 30, 2019 by Dr Donald KinghornI've done some testing with 2 NVIDIA RTX Titan GPU's running machine learning jobs with TensorFlow. The RTX Titan is a great card but there is good news and bad news.