Getting set-up for neural networks: external or internal GPU?
I'm not sure I should be asking this here, but this seems like the one place I know of where people have a lot of practical experience with neural networks.
I'm trying to set up a rig for neural nets. I've got a desktop tower, but I'd need to get a bigger power supply for the RTX 2080 GPU I'm considering and possibly more (noisy) fans.
But an option might be to attach an external GPU. An external solution addresses the above issues and might make it possible to add GPUs if needed and perhaps makes the GPU mobile (use it at home and office).
Does anyone know what kind of performance hit an external GPU would involve? The RTX 2080 has a memory bandwidth of 448 GB/s compared with the T3's transfer rate of 5GB/s or, if it's possible to connect an external GPU directly to the PCI-e bus, maybe 32 GB/s. Then again, I don't know how much bandwidth is needed between the graphics card and the rest of the computer. I'm also not sure whether linux works with external GPUs.
Anyone have any relevant info?