AMD ROCm vs. Vulkan Performance For Lemonade Local AI Server With Llama.cpp

A Phoronix Premium reader recently inquired about seeing some new benchmarks of AI performance between Vulkan and AMD ROCm back-ends to see how the situation plays out today. Here are some fresh benchmarks on two separate systems with AMD Radeon graphics and using the Lemonade local AI server while exploring the difference between the ROCm and Vulkan Llama.cpp back-ends.

≈