I looked into those recently, actually expected the GPUs to be a lot farther behind than they are. The things that are really pushing them back are the drivers and the outdated process node, but there are already GPUs comparable to the lower end current generation cards from the 3 big manufacturers on paper (and even those have 16GB of VRAM, Nvidia 😤).
Plus, they're all connected. 1 gram of water is 1 milliliter and takes up 1 cubic centimeter.
To heat said water by 1 degree celsius (or kelvin) you need one calorie. If one newton were to displace that water through the distance of one meter, the amount of work done would be 1 milijoule.
Americans explaining the downfall of the roman empire: "Imagine a McDonald's..."