Batch size is an important hyper-parameter for Deep Learning model training. When using GPU accelerated frameworks for your models the amount of memory available on the GPU is a limiting factor. In this post I look at the effect of setting the batch size for a few CNN’s running with TensorFlow on 1080Ti and Titan V with 12GB memory, and GV100 with 32GB memory.
Puget Systems builds custom PCs tailored for your workflow
Extensive in-house testing
making you more productive and giving you more performance for your dollar
Reliable workstations
with fewer crashes and blue screens means more time working, less time waiting on your computer
Support that understands
your complex workflows and can get you back up and running ASAP
Proven track record
check out our customer testimonials and Reseller Ratings
Select your workflow: