[FIXED] Watchdog DPC Violation Error with Multiple NVIDIA GPUs
Written on May 11, 2018 by Ken ColorossiIntroduction
Recently we have been seeing an issue in our support department with a specific hardware combination: the Asus X99E-10G WS motherboard and triple or quad NVIDIA GPU configurations. When running a workload that is heavy on both the CPU and GPUs, systems with this hardware can crash and give the DPC_WATCHDOG_VIOLATION error or "blue screen of death" (BSOD).
We have created an instructional video to guide users through resolving this problem by reverting to an older NVIDIA graphics driver and then preventing Windows from automatically updating to a newer version. We are also currently coordinating with NVIDIA on a permanent fix. Updates will be published to the article as they become available.
Updates
Final Update 9/10/2018 [SOLUTION]
We have identified a solution that mitigates the DPC errors and while it does not completely solve the problem, in all testing the systems are significantly more stable with fewer crashes. If you need to update to the newest NVIDIA driver in order to run a particular application then this adjustment will help you. If you do NOT need to update in order to run an application we would advise against deploying the adjustment. The adjustment involves editing the registry so at this time we are not releasing a detailed guide however we are releasing an executable that will perform the registry edits for you.
Please navigate HERE and download the files to your affected computer. Once downloaded, run the application to perform the adjustment.
Alternatively, if you have any questions or prefer our Puget Systems Support staff perform the adjustment please don't hesitate to reach out; we are here to help!
Update 6/13/2018
Nivida has stated that the watchdog BSOD w/ multi GPU on X99-E 10G WS is now a "blocking issue", which means they cannot release a new driver unless it contains a fix.
Update 5/24/2018
With the release of new drivers Nvidia has removed the 382.53 driver from their list. You can access the download from the Nividia database here.
Update 5/15/2018
Currently Nivida has been able to replicate this issue in their lab and are working on a solution.
How to install NVIDIA Graphics Driver v382.53
The video is embedded below but if you would prefer to read the instructions rather than watch it you can click here to see the script text.
Video Script:
Today, we will demonstrate how to find, install, and hide the older driver for the Nvidia GPU problem with the DPC_WATCHDOG_VIOLATION. The issue is with the Asus X99E-10G WS motherboard and a triple or quad Nvidia GPU stack. When running a GPU and CPU heavy workload, it will cause the system to crash and give the DPC_WATCHDOG_VIOLATION, which looks like this. (SHOW SCREENSHOT).
Step 1: Revert to Older Graphics Driver
So we are going to go to “nvidia.com” then “click on support” then select “Download Drivers” then down in the “Beta, Older drivers and more” section select “Beta and Older Drivers” For this system, we are going to use the defaults because that is all correct. However, if you have GTX1080s or Titans, you’ll need to change the Product drop down to match your system.
From there, we are going to click “Search.” We are going to download the the driver version “382.53” by clicking on “GeForce Game Ready Driver,” then click “Download” and finish by clicking “Agree & Download.”
Once the download is complete. Close your browser, open file explore and navage to the downloads folder
Now, we are going to double click on the file, select yes to the “Do you want the app to make changes to your desktop?” Once you’ve done that, select “OK” on the “Specify the folder where the driver files are to be saved” that is going to unpack where it needs to for installation and start the installer. Next click Agree and Continue to the “License Agreement” then select “Custom” and “NEXT.” We are doing this so we can select “Perform a clean installation” This is very important. Also we are going to un select “NVIDIA GeForce Experience.” This is for gamers and isn’t needed for what we are doing.
Then click “NEXT” This will remove all remanence of the new driver and install the older 382.53 driver. Now that it is done with the removal we will restart the system by clicking “Restart Now” and when we come back it will automatically start the installer. Now that the driver is finished installing we will restart by clicking “Restart now”.
Step 2: Installing Wushowhide
Now that the driver is installed, let’s download and run a program from Microsoft to hide the NVIDIA driver from Windows Update so it doesn't try and force install the newer driver again. We are going to do a Google search for wushowhide (windows update show hide). We want the one what shows it’s from Microsoft. We are going to scroll down to the section “For Windows 10 v1607 (Anniversary Update) and click on “Download the “Show or hide updates” troubleshooter package now” .
Now we are going to go back to our Downloads folder and open the wushowhide program.
This may need to be run a few times until the NVIDIA driver update shows up. So we are going to double click on the file to run it. We are going to click on “Next”. It’s going to look for pending updates. Then we are going to click on “Hide Updates” Then we are going to select the NVIDIA Display driver and click “NEXT”. It will end at “Troubleshooting has completed” then click “Close” and you are done.
Conclusion
We hope you found the video above helpful!
If you do not own a Puget System, but are experiencing this issue and need assistance, please go here to submit a help request with NVIDIA directly. You may also want to contact the manufacturer of your system for additional support.
Need help with your Puget Systems PC?
If something is wrong with your Puget Systems PC. We are readily accessible, and our support team comes from a wide range of technological backgrounds to better assist you!
Looking for more support guides?
If you are looking for a solution to a problem you are having with your PC, we also have a number of other support guides that may be able to assist you with other issues.