The shape of the mirror between a Ramco and a pancake farmtruck mirror from the 70s... not even close. The Ramco is significantly larger and four times the depth. It is marginally closer to the body, but mostly because it is wider. The Ramco arm is also comparatively large with regard to the fact that the factory arm is a piece of 3/4" round bar stuck to a piece of stamped steel.
I suspect the "aerodynamic" nature of the mirror is causing the problem. If it were ugly and flat I bet there is enough air disturbance to cause a wash that it doesn't happen.
The part that has my attention is that no one else has had this problem. If I spent $480 for a set of mirrors I'm going to hassle with then why didn't I just build some arms out of stainless and slap on a cheap pair of Velvac fleabay mirrors for $50? I was trying to buy myself out of a time vampire.
I'm wondering if all the time I've spent trying to seal up the interior and the modifications related to the front has caused me all of this grief. If I open a window inside (preferably the one in front of the door) the problem goes away.