What considerations need to be made when starting off running LLMs locally?


What considerations need to be made when starting off running LLMs locally?

What effect, if any, does a system’s CPU speed have on GPU inference with CUDA in llama.cpp?

How does the choice of Operating System affect image generation performance in Stable Diffusion?

With 2023 at a close, we wanted to look back at the sales trends we saw for CPU, GPU, storage, and OS.

How does performance compare across a variety of consumer-grade GPUs in regard to SDXL LoRA training?

How does performance compare across a variety of professional-grade GPUs in regard to SDXL LoRA training?

AMD has published a guide outlining how to use Microsoft Olive for Stable Diffusion to get up to a 9.9x improvement in performance. But is that enough to catch up to NVIDIA?

NVIDIA has released a TensorRT extension for Stable Diffusion using Automatic 1111, promising significant performance gains. But does it work as advertised?

In DaVinci Resolve 18.6, Blackmagic is claiming up to a 4x improvement in Neural Engine performance for AMD GPUs, and a 2x improvement for NVIDIA. Is this a true claim, or a matter of cherry-picked results that won’t impact most users?

Blender expands AMD GPU support with HIP-RT integration. What is HIP-RT, and how much does it impreove rendering times?