I’ve been running that setup as my main workstation for over 3 years. Use an nVidia gpu and a dedicated usb card for IO.
You also need a second machine to do esx management, I have a laptop. And a second video card to see the esx console (handy when it isn’t working).
Finally don’t use multiple drives for esx datastores, there is no way to remove them later (to upgrade or replace failed drives). I learnt the hard way, transferring 6TB of vms over usb 2 is not fun.