Open source found a way to nearly double the RTX 3,090's computing power.

Open source found a way to nearly double the RTX 3,090's computing power.

The gpu unlock project has already gained more than 5,000 stars on GitHub in a few days:. Let's figure it out. GeForce 30 series graphics cards (including RTX 3080, 3090, 3090 Ti, etc.) have tensor cores that can multiply matrices in FP16 and BF16 with the result aggregated in FP32. By doing this, neural networks are trained and activated. However, since these are gaming GPUs, Nvidia has specifically limited this operating speed on them in software. Classic market segmentation: if you want to do ML, pay for an ML graphics card, not for gaming. The limitation is made as a class of the speed of issuing the instructions, and its value lies in registers that normally cannot be written to. I mean, you can't bypass this thing directly. But the author of this turnip found a way to break it. The author took a technique previously invented to unlock similar limitations of CMP 170HX mining cards, and designed it as a Linux kernel module. It turns on at boot, before the NVIDIA driver is activated, registers full speed and only then gives the card to the stock driver. The main thing is that the module works before the driver, so there is no need to fix the driver with every update and/or renew the BIOS. Database data for 3,090 Ti (GEMM 8,192, 450 W): . BF16 87,5 157,4 TFLOPS.

FP16 87,5 118,4 TFLOPS.

TF32 42,6 82,6 TFLOPS.

In real missions, the increase is a little more modest, but it is there. Prefill LLM is accelerated by about 14-36%. The results of the calculations are partially the same as the previous ones. The original repository is only for Linux, but there are already third-party ports for Windows, for example. Installation instructions are in the repo. We are raising our retirement age of 3,090.