Discover/llama: use f16 mask for FA to save VRAM by am17an · Pull Request #23764 · ggml-org/llama.cpp

article

llama: use f16 mask for FA to save VRAM by am17an · Pull Request #23764 · ggml-org/llama.cpp

r/LocalLLaMA · 0 upvotes

Type

article

Stars

Added

May 29, 2026

Join builders getting curated tech discoveries every week. No spam.

No spam. Unsubscribe anytime.

↗Related Items

article🟤 Reddit

⭐ 344

r/MachineLearning · 86 upvotes

article🟤 Reddit

⭐ 312

r/MachineLearning · 78 upvotes

article🟤 Reddit

⭐ 50

r/MachineLearning · 0 upvotes