Living between Los Angeles and St Andrews has meant living between two wardrobes, but as America turns away from athleisure, I’m left wondering whether comfort and polish can coexist.