Two T4s, 31 Gigabytes of RAM, and the Myth of the VRAM Wall
A 33.1 billion parameter image model rendered 4096 by 4096 pixels on a single 15 gigabyte Tesla T4 while the second card sat idle. Four benchmark campaigns on the same free Kaggle machine kept finding the same boundary: host RAM, not VRAM, and the fixed cost of encoding before a single sample is taken.
