Skip to content
Sign in
Artwork for Tech Rants
Tech Rants · Today · 1 hr 3 min

The VRAM Cheat Code

VRAM prices are insane. Legacy cards are the answer. Upcast BF16 to FP32. Use mixed INT8 quantization. This saves thousands of dollars. It unlocks massive memory pools. Blog: https://ojambo.com/bf16-upcasting-secret-for-legacy-gpus Amazon Storefront: https://amzn.to/4xevbes - Explore the hardware, tools, and gear I use and recommend. Video: https://youtube.com/live/ha19Ft7Pbgk Books: https://www.amazon.com/stores/Edward-Ojambo/author/B0D94QM76N Woodworking Blueprints: https://ojamboshop.com Tutorials: https://ojambo.com/contact Consultations: https://ojamboservices.com/contact #VRAM #ROCm #AI

0:00-1:03:57
Play in

transcript

No transcript — this publisher did not publish one.

show notes

VRAM prices are insane. Legacy cards are the answer.


Upcast BF16 to FP32. Use mixed INT8 quantization.


This saves thousands of dollars. It unlocks massive memory pools.


Blog: https://ojambo.com/bf16-upcasting-secret-for-legacy-gpus


Amazon Storefront: https://amzn.to/4xevbes - Explore the hardware, tools, and gear I use and recommend.


Video: https://youtube.com/live/ha19Ft7Pbgk

Books: https://www.amazon.com/stores/Edward-Ojambo/author/B0D94QM76N

Woodworking Blueprints: https://ojamboshop.com

Tutorials: https://ojambo.com/contact

Consultations: https://ojamboservices.com/contact


#VRAM #ROCm #AI

more episodes

All episodes