I knew that sounded familiar. A couple years back, I was researching the Blackmagic Intensity Shuttle USB3, and they advertised issues with ASMedia USB3 chips. Looking again, there’s a thread on the Blackmagic forums that discusses precisely this issue. I imagine the problems that plague the Intensity Shuttle on ASMedia USB3 chipsets are the same that are plaguing your Elgato Cam Link.
Well fingers crossed this fixes the issue when it arrives tomorrow.