Puget Systems Adobe Premiere Pro CC BenchmarkWritten on July 8, 2019 by Matt Bach
At Puget Systems, one of our primary goals is to make sure that our customers end up with a fast, reliable workstation that is perfectly tailored to their unique workflow. The main way we do this is by benchmarking a wide range of hardware in Premiere Pro (and numerous other software packages) that we then publish in our ongoing series of hardware articles.
However, while this ensures we are selling the right hardware, it does not give our customers a great idea of how much faster a new workstation would be compared to their existing system. To address this issue, we are making our internal Pr benchmark available for public download so that anyone can compare their own computer to our latest Premiere Pro hardware articles. Even better, this benchmark is compatible with both Windows and Mac-based systems!
Note that we have our benchmark divided into three separate downloads. The Benchmark Extension is the actual utility that runs the benchmark itself and needs to be installed before use. Currently this is a stand-alone extension, but we may make it available on Adobe Exchange in the future.
The other two downloads contain the test media and project file. If you are only looking to benchmark general performance in Premiere Pro, the "Standard" test files is all you need and include 59.94FPS H.264, ProRes 422, and RED footage. However, if you want to test every codec available in our benchmark, there is an optional 16GB download containing all the other footage used in our benchmark.
If you want to run the full benchmark, note that you actually need to download both sets of test files and combine them together. The Premiere Pro and Photoshop project files are identical in both downloads so it does not matter which you overwrite.
This benchmark is an early beta. If you have any suggestions, concerns, or recommendations, we encourage you to leave your thoughts in the comments at the bottom of the page.
If you are interested in how your system performs in other creative applications, we are currently working on making our benchmarks available to the public. At the moment, we have the following benchmarks available:
How to run the benchmark
After downloading the benchmark and media test files, unzip them to a convenient location. We recommend placing the media test files on the same drive that you store your active project media as storage performance can affect the results. However, be sure that they stay on a local drive as network-based drives will not always work properly.
Next, install the benchmark extension by running either the "Install_Benchmark.exe" or "Mac_Install_Benchmark.command" files in the benchmark folder depending on your operating system.
With the benchmark installed, open the "Benchmark_Project.prproj" project file and follow the instructions shown in the "Benchmark Instructions" composition including starting the extension under "Window->Extensions->Puget Systems Pr Benchmark".
Note that while a there are no configuration options that need to be set, there are a few things you need to ensure are done before running the benchmark depending on your OS.
- Windows: make sure that the program window is in the upper-right quadrant of the Premiere Pro application. We need to use an external app that clicks in this are in order to change the playback resolution.
- MacOS: you need to go to "Security & Privacy" and add Premiere Pro to the Accessibility list. In addition, a few seconds or minutes after the benchmark starts, a popup will come up that asks you to allow Premiere Pro access System Events. Again, this is so that we can change the playback resolution (via the top menu bar).
Once these settings are taken care of, you can run one of three benchmark presets or individually benchmark any of the test media. The three presets test the following:
- Standard: Tests 4K H.264 150Mbps 8-bit (59.94FPS), 4K ProRes 422 16bit (59.94FPS) and 4K RED (59.94FPS) media in addition to the 4K Heavy GPU Effects (59.94FPS) and 4K Heavy CPU Effects (59.94FPS) tests
- Full: Includes all the 29.97FPS and 59.94FPS media and GPU/CPU Effects tests (Note: you will need both sets of test media to run this test)
When the benchmark is complete, it will give you an "Overall Score" for the type of test you ran. A log file is generated in the benchmark folder that includes these scores as well as the FPS for each individual task. You can compare your scores to those in our Premiere Pro hardware articles - just make sure they used the same benchmark version!
What is tested?
Our Premiere Pro benchmark looks at both live playback and export performance with a wide range of codecs at 4K and 8K resolutions as well as at 29.97 and 59.94 FPS. In addition, there are dedicated "Heavy GPU Effects" and "Heavy CPU Effects" sequences that are designed to individually stress the GPU and CPU beyond what a typical Premiere Pro user will do.
Our test media consists of the following resolutions and codecs:
|Test Media (29.97 & 59.94 FPS)|
|4K H.264 150mbps 10-bit (29.97FPS)||4K H.264 150mbps 8-bit (59.94FPS)|
|4K ProRes 422 16-bit||4K ProRes 4444 16-bit|
|4K RED||4K CinemaRaw Light|
|8K H.265 100mbps||8K RED|
Special Thanks to:
Chris Shreve (Christopher Shreve Media) for the 4K CinemaRaw Light clips from his Canon C200.
Neil Purcell (Lighting Cameraman / Camera Operator) for the 4K H.254 clips from his Panasonic GH5.
For each type of test media, we look at two test sequences:
- Lumetri Color - 3 clips in series with a Lumetri Color effect applied
- MultiCam - 12 clips across four tracks in a multicam sequence. Playback is tested in "Multi-Camera" display mode.
In addition, we have a "Heavy GPU Effects" sequence using:
- 10 ProRes 422 clips in series
- Cross Dissolve, Dip to Black, Dip to White, and Wipe transitions between clips
- Lumetri Color and VR De-Noise effect applied to half the clips
- Lumetri Color, Ultra Key, Sharpen, Gaussian Blur, Basic 3D, VR Digital Glitch, and Directional Blur effects applied to the other half of the clips
and a "CPU Heavy Effects" sequence using:
- 10 ProRes 422 clips in series
- Additive Dissolve, Page Peel, Center Split, and Band Wipe transitions between clips
- All clips have two of the following effects applied: Lens Flare, Dust & Scratches, Noise, Lighting Effects, and Magnify
These tests are all used for live playback performance testing at Full and Half playback resolution. All except the MultiCam sequence are also used to test export performance using the "Youtube 2160p 4K Ultra HD" preset (H.264, 4K, 40mbps) as well as exporting to 4K ProRes 422HQ 8-bpc.
This benchmark is designed for Premiere Pro CC 2019 and should run on virtually any Windows or Mac-based system with at least 16GB of system memory and 4GB of VRAM.
Note that this benchmark is still in BETA. Plug-ins and customized preferences in particular may prevent the benchmark from running properly. If you run into any issues, we recommend resetting your preferences to default - be sure to make a backup first!
How does the scoring work?
The scoring system used in our benchmark is based on the performance relative to the FPS of the test media. If the media is 29.97FPS and the system plays it back at 29.97FPS, that results in a score of "100". Likewise, if it can only play back at half the FPS, the score would be "50". Scores for Live Playback cannot go above 100 (since you cannot play at faster than the media's FPS), although scores for Exporting can go well above 100 depending on the performance of the system.
The Live Playback and Export scores are all combined into the "Standard", and "Full" Overall scores depending on the benchmark preset you chose.
Version 0.3 BETA
- Replaced H.264 media with footage straight from a Panasonic GH5 (Thanks Neil Purcell!)
- Replaced "Quick" preset with "Standard" preset. Changed tested media to 59.94FPS instead of 29.97FPS.
- This was done with the intention of having a benchmark preset that is geared towards measuring the overall performance of a system in as little time as possible.
- Separated media files into two groups: a "Standard" set and a "Full" set to make the download much more manageable for people just doing the Standard preset.
- Due to the change in the test media, the overall scores are not interchangeable with previous benchmark versions
Version 0.2 BETA
- First release.
Looking for an Premiere Pro Workstation?
Puget Systems offers a range of workstations that are tailor made for your unique workflow. Our goal is to provide most effective and reliable system possible so you can concentrate on your work and not worry about your computer.