ended6월 18일· 1 sources
llama-bench Restores Flash Attention Defaults for GPU Acceleration
llama-bench, GPU 가속화를 위한 Flash Attention 기본값 수정
Why it matters
Build b9437 fixes a critical oversight where llama-bench previously disabled Flash Attention by default, even on GPU-accelerated hardware. This change aligns llama-bench with llama-server and llama-cli by automatically enabling Flash Attention on capable backends (CUDA, Metal, Vulkan), delivering proper GPU acceleration for performance benchmarking. Users with pre-b9437 baselines on GPU hardware should re-run their tests to ensure results accurately reflect actual performance with Flash Attention enabled.
1
Sources
+0
24h
—
Growth
95d
Active
llama-benchFlash AttentionGPU optimizationCUDAGGUF