GPU-unlock: FP/BF16 instruction issue rate on Nvidia 3000's cards(github.com)
331 points by fragebogen 1 day ago | 76 comments
tl;dr: A Linux kernel module unlocks the FP16/BF16/TF32 instruction issue rate on Nvidia Ampere GeForce cards (GA102/103/104/106) to match their professional equivalents, roughly doubling matrix throughput (e.g., a 3090 Ti goes from 87 to 157 TFLOPS on BF16 GEMM). It applies the CMP V67/PLM unlock via initramfs before the Nvidia driver binds, avoiding the need to patch the driver on each release. Gains benefit LLM prefill, diffusion, and FlashAttention workloads, while memory-bound tasks like LLM decode are unchanged; outputs remain bit-identical.
HN Discussion:
  • ↑Author of the unlock engaging with the community and offering to answer questions
  • ↑Related unlocks exist for other Nvidia features like P2P and NVENC, criticizing Nvidia's artificial restrictions
  • ↑The unlock works and provides real value for ML researchers on consumer hardware
  • ~Caveats about power/thermal requirements and risks of bricking cards temper the claimed benefits
  • ↓Real-world gains are significantly smaller than the article's advertised numbers