Ah hah! That’s what it is then! The TV recovers very quickly and cuts out nothing, but the capture card takes longer to re-sync up so it misses good chunks while it switches resolutions.
I suppose that solves the mystery then, not really anything to be done about it.
Could be worse.