Puget Systems print logo

https://www.pugetsystems.com

Read this article at https://www.pugetsystems.com/guides/1519
Article Thumbnail

Puget Systems Adobe Premiere Pro CC Benchmark

Written on July 8, 2019 by Matt Bach
Share:

At Puget Systems, one of our primary goals is to make sure that our customers end up with a fast, reliable workstation that is perfectly tailored to their unique workflow. The main way we do this is by benchmarking a wide range of hardware in Premiere Pro (and numerous other software packages) that we then publish in our ongoing series of hardware articles.

However, while this ensures we are selling the right hardware, it does not give our customers a great idea of how much faster a new workstation would be compared to their existing system. To address this issue, we are making our internal Pr benchmark available for public download so that anyone can compare their own computer to our latest Premiere Pro hardware articles. Even better, this benchmark is compatible with both Windows and Mac-based systems!

Puget Systems Premiere Pro Benchmark

Note that we have our benchmark divided into two separate downloads. The Benchmark Extension is the actual utility that runs the benchmark itself and needs to be installed before use. Currently this is a stand-alone extension, but we may make it available on Adobe Exchange in the future.

The second download is the test media and project file. This is a ~20GB download that can be unzipped to any drive on your system. We recommend placing it on the same drive you typically work from as drive speed can affect performance in many of the tests.

If you are interested in how your system performs in other creative applications, we care currently working on making our benchmarks available to the public. At the moment, we have the following benchmarks available:

How to run the benchmark

After downloading the benchmark and media test files, unzip them to a convenient location. We recommend placing the media test files on the same drive that you store your active project media as storage performance can affect the results. However, be sure that they stay on a local drive as network-based drives will not always work properly.

Next, install the benchmark extension by running either the "Install_Benchmark.exe" or "Mac_Install_Benchmark.command" files in the benchmark folder depending on your operating system.

With the benchmark installed, open the "Benchmark_Project.prproj" project file and follow the instructions shown in the "Benchmark Instructions" composition including starting the extension under "Window->Extensions->Puget Systems Pr Benchmark".

Puget Systems Premiere Pro benchmark settings

Note that while a there are no configuration options that need to be set, there are a few things you need to ensure are done before running the benchmark depending on your OS.

  • Windows: make sure that the program window is in the upper-right quadrant of the Premiere Pro application. We need to use an external app that clicks in this are in order to change the playback resolution.
  • MacOS: you need to go to "Security & Privacy" and add Premiere Pro to the Accessibility list. In addition, a few seconds or minutes after the benchmark starts, a popup will come up that asks you to allow Premiere Pro access System Events. Again, this is so that we can change the playback resolution (via the top menu bar).

Once these settings are taken care of, you can run one of three benchmark presets or individually benchmark any of the test media. The three presets test the following:

  • Quick: Tests 4K H.264 50Mbps (29.97FPS), 4K ProRes 422 16bit (29.97FPS) and 4K RED (29.97FPS) media in addition to the 4K Heavy GPU Effects (29.97FPS) and 4K Heavy CPU Effects (29.97FPS) tests
  • 29.97FPS Media: All 29.97FPS media tests
  • 29.97+59.94FPS Media: Includes all 29.97FPS and 59.94FPS media

When the benchmark is complete, it will give you an "Overall Score" for the type of test you ran. A log file is generated in the benchmark folder that includes these scores as well as the FPS for each individual task. You can compare your scores to those in our Premiere Pro hardware articles - just make sure they used the same benchmark version!

What is tested?

Our Premiere Pro benchmark looks at both live playback and export performance with a wide range of codecs at 4K and 8K resolutions as well as at 29.97 and 59.94 FPS. In addition, there are dedicated "Heavy GPU Effects" and "Heavy CPU Effects" sequences that are designed to individually stress the GPU and CPU beyond what a typical Premiere Pro user will do.

Our test media consists of the following resolutions and codecs:

Test Media (29.97 & 59.94 FPS)
4K H.264 50mbps 4K H.264 100mbps 10-bit
4K ProRes 422 16-bit 4K ProRes 4444 16-bit
4K RED 4K CinemaRaw Light
8K H.265 100mbps 8K RED

For each type of test media, we look at two test sequences:

  1. Lumetri Color - 3 clips in series with a Lumetri Color effect applied
  2. MultiCam - 12 clips across four tracks in a multicam sequence. Playback is tested in "Multi-Camera" display mode.

In addition, we have a "Heavy GPU Effects" sequence using:

  • 10 ProRes 422 clips in series
  • Cross Dissolve, Dip to Black, Dip to White, and Wipe transitions between clips
  • Lumetri Color and VR De-Noise effect applied to half the clips
  • Lumetri Color, Ultra Key, Sharpen, Gaussian Blur, Basic 3D, VR Digital Glitch, and Directional Blur effects applied to the other half of the clips

and a "CPU Heavy Effects" sequence using:

  • 10 ProRes 422 clips in series
  • Additive Dissolve, Page Peel, Center Split, and Band Wipe transitions between clips
  • All clips have two of the following effects applied: Lens Flare, Dust & Scratches, Noise, Lighting Effects, and Magnify

These tests are all used for live playback performance testing at Full and Half playback resolution. All except the MultiCam sequence are also used to test export performance using the "Youtube 2160p 4K Ultra HD" preset (H.264, 4K, 40mbps) as well as exporting to 4K ProRes 422HQ 8-bpc.

Sample Results

While our latest Premiere Pro Hardware Articles will have the most up to date results (just make sure the benchmark version matches!), below are some sample results with Pr CC 13.1.2 and V0.2b of our benchmark:

Intel Core i9 9900K 8 Core, 128GB of RAM, NVIDIA GeForce RTX 2080 8GB

  • Overall 29.97+59.94FPS Media Score: 766.5
  • Overall 59.94FPS Media Score: 579.5
  • Overall 29.97FPS Media Score: 954
  • Overall Quick Score: 1068.5

Intel Core i9 9940X 16 Core, 128GB of RAM, NVIDIA GeForce RTX 2080 Ti 11GB

  • Overall 29.97+59.94FPS Media Score: 846
  • Overall 59.94FPS Media Score: 670
  • Overall 29.97FPS Media Score: 1022
  • Overall Quick Score: 1163

AMD Ryzen 7 2700X 8 Core, 64GB of RAM, NVIDIA GeForce RTX 2080 Ti 11GB

  • Overall 29.97+59.94FPS Media Score: 603.5
  • Overall 59.94FPS Media Score: 474
  • Overall 29.97FPS Media Score: 733
  • Overall Quick Score: 907.5

Apple iMac Pro 14 Core, 64GB of RAM, Radeon Pro Vega 64

  • Overall 29.97+59.94FPS Media Score: 622.5
  • Overall 59.94FPS Media Score: 491
  • Overall 29.97FPS Media Score: 753.5
  • Overall Quick Score: 816.5

Compatibility

This benchmark is designed for Premiere Pro CC 2019 and should run on virtually any Windows or Mac-based system with at least 16GB of system memory and 4GB of VRAM.

Note that this benchmark is still in BETA. Plug-ins and customized preferences in particular may prevent the benchmark from running properly. If you run into any issues, we recommend resetting your preferences to default - be sure to make a backup first!

How does the scoring work?

The scoring system used in our benchmark is based on the performance relative to the FPS of the test media. If the media is 29.97FPS and the system plays it back at 29.97FPS, that results in a score of "100". Likewise, if it can only play back at half the FPS, the score would be "50". Scores for Live Playback cannot go above 100 (since you cannot play at faster than the media's FPS), although scores for Exporting can go well above 100 depending on the performance of the system.

The Live Playback and Export scores are all combined into the "Quick", "29.97FPS Media", "59.94FPS Media", and "29.97+59.94FPS Media" Overall scores depending on the benchmark preset you chose.

Update Log

Version 0.2 BETA

  • First release.

Looking for an Premiere Pro Workstation?

Puget Systems offers a range of workstations that are tailor made for your unique workflow. Our goal is to provide most effective and reliable system possible so you can concentrate on your work and not worry about your computer.

Configure a System!

Tags: Premiere Pro, Benchmark, Public
Hwgeek

Can't wait for your review for Ryzen7/9 and 3950X in future, from other reviews I saw- looks like the 3900X will be your favorite CPU- better then 9900K and even challenging 7980XE/9980XE even in ADOBE :-).
https://nl.hardware.info/re...

Posted on 2019-07-09 07:31:19
Spale Max

Results are completely off.
I mean 9700k is faster than 9900k in your review, is there anything else to add?

Posted on 2019-07-09 16:06:59
Hwgeek

IDK, here another test in Pro apps- 3900X competing with 9980XE and 2950X!
https://techgage.com/articl...
So the 3950X will completely destroy Intels X299 linup in pro apps.

Posted on 2019-07-10 08:44:20
simonxliu

Adobe software isn't well optimized to use multiple threads and loves single threaded performance. There are plenty of lightly threaded workloads out there that actually benefit from disabling Hyper Threading(a 9700K is just a 9900K without HT) since it increases processing latency and you only start to see benefits from Hyper Threading when you have more simultaneous threads. Games, which also often aren't well optimized to use multiple threads, sometimes perform better on a 9700K(or even just a 9900K with HT manually disabled) compared to a 9900K.

Posted on 2019-07-12 13:32:34
Yariv Nachshon

A new review with Old CPUs ? Seems like the new Ryzen is all what people care for.

Posted on 2019-07-09 08:53:39

Do you mean the sample results? This is just the benchmark information/download page, not a hardware review. Those are just there to give people an idea of normal scores until we have articles published using this benchmark (like our Ryzen 3rd generation first look articles that are up)

Posted on 2019-07-09 15:32:08
Yariv Nachshon

Yes. i understand it but there is no option for it in the sample results list at all :-(
Even mentioning is with a score of zero will make it more interesting to re-examine :-)

https://www.pugetsystems.co...

Posted on 2019-07-09 16:59:42
RDarvan

Would it be possible to add a 1080p files test to the benchmark?
for slightly more modest configs...

Posted on 2019-07-10 07:38:49

We have gone back and forth on that, and ended up deciding against it for a couple of reasons:
1) 1080p is just too easy for the kinds of systems we are typically testing ourselves. If anything can do our playback tests at full FPS, then there is no measurable difference beyond exporting
2) The relative difference between hardware tends to be very similar regardless of whether you are testing 1080p or 4K media. So even if you do just work with 1080p footage, the 4K results are still pretty valid (even if they don't tell you exactly what FPS you could expect)
3) We already have way too many tests

In many ways, #3 is the main limiting factor. Nothing is really stopping us from adding 1080p, but it comes down to benchmark time vs reward.

Posted on 2019-07-10 16:48:58
RDarvan

Thank you for the explanation!

Posted on 2019-07-11 01:31:43
Mefist

1080 Ti?

Posted on 2019-07-10 07:56:43
MacherTV_Peter

Great article, but where is the Ryzen 3900x Premiere Pro review? :D jk.

Posted on 2019-07-10 14:16:41
Matthew Fitz

Very generous of you to share these publicly. I am keenly interested in when the light-room benchmark becomes a public beta also as was previously mentioned. Eagerly waiting to see how Ryzen 3000 takes to Photoshop and Light-room.

Posted on 2019-07-11 02:09:18
Mark Harris

Thanks for sharing this!

Posted on 2019-07-11 19:22:49
Matt

Just downloaded it and was able to restore the archive file. When opening the Premiere project it seems there is a missing .psd file? Benchmark Setup.psd

Posted on 2019-07-12 19:03:37

Are you on Mac or PC? So far, it seems like PC can unzip it just fine , which is very odd.

Fortunately, that PSD isn't really necessary. It is just the setup instructions which are listed on this page on the "How to run the benchmark" section. Or just look at https://www.pugetsystems.co... . Delete it, mark as offline, whatever. It won't affect the benchmark at all.

Posted on 2019-07-12 19:10:07
Matt

On a mac. , I'll give it a run through, thanks.

Posted on 2019-07-12 19:28:11
Matt

It looks like the restore is missing more files than I thought. https://uploads.disquscdn.c... https://uploads.disquscdn.c...

Posted on 2019-07-12 19:41:57
Matt

the bottom list is what was unzipped.

Posted on 2019-07-12 19:42:20

So weird that it works fine on PC... I already have a plan in place to split up the zip across two files since most people aren't going to actually run the full benchmark. Hopefully that will fix it.

I'm actually out of the office right now, but I'll try to get a new zip file(s) uploaded early next week.

Posted on 2019-07-12 20:03:41
Matt

Thanks, I just wanted to let you all know, have a great weekend!

Posted on 2019-07-12 20:06:35
Ann Bens

https://uploads.disquscdn.c...

Unzipping the movie files gives a Headers Error

Resulting in not loading up in Pr. during the Quick test

Posted on 2019-07-12 22:20:36
Scott Moore

I've tried running the benchmark several times (and selecting several different options) and nothing seems to work. I get the "copying media" notification and then nothing else happens. Logs seem to point to an error with copying some of the media https://uploads.disquscdn.c...

Posted on 2019-07-16 21:24:45

We're uploading a new set of benchmark files right now since it looks like there was some corruption in the original zip file. Check the download links in a few hours - that should resolve the issue.

Posted on 2019-07-16 21:28:04
Scott Moore

Sweet, thanks Matt! will keep an eye out for it

Posted on 2019-07-16 21:43:39
Scott Moore

Hey Matt, got it working now!
I don't think the download/zip was my issue as the new download ran into the same "some media not copied" error.
I moved the project folder to my system drive, it was previously on my media drive which is a network drive, and that seemed to get it working correctly.
Not sure if that was in any of the instructions or not but might be helpful for problem solving going forward?
Thanks!

Posted on 2019-07-17 03:18:27

Oh, interesting, I didn't even think about network drives. It should work fine if it is mounted to a drive letter, although I'm not completely sure how it would handle it on Mac. We're mostly using the Premiere Pro SDK, and I'm not confident the file management in it can handle things like that.

Thanks for the heads up, I'll at the very least update the instructions to mention this!

Posted on 2019-07-17 16:34:34