| GPU-unlock: FP/BF16 instruction issue rate on Nvidia 3000's cards(github.com) | |
| 331 points by fragebogen 1 day ago | 76 comments | |
tl;dr: A Linux kernel module unlocks the FP16/BF16/TF32 instruction issue rate on Nvidia Ampere GeForce cards (GA102/103/104/106) to match their professional equivalents, roughly doubling matrix throughput (e.g., a 3090 Ti goes from 87 to 157 TFLOPS on BF16 GEMM). It applies the CMP V67/PLM unlock via initramfs before the Nvidia driver binds, avoiding the need to patch the driver on each release. Gains benefit LLM prefill, diffusion, and FlashAttention workloads, while memory-bound tasks like LLM decode are unchanged; outputs remain bit-identical. | |
HN Discussion:
| |