What Nvidia brings to the table with both the Jetson line and the Tegra line is precisely those GPGPU's. The ARM parts are pretty standard I believe.
What I meant was if there was enough interest and development around an open-source architecture for GPGPU's and Neural processing it would have the potential to become a competitor to Nvidia's offering. I am confident it would take years to become a worthy competitor in the desktop and server markets. Edge and portable devices I am not so sure.