Or that he might be looking at multiple retreats. After all, even the Czars of Russia had their Winter Palace (in Kiev) and their Summer Palace (in St. Petersburg) when they wanted to get away from Moscow. Romney may be planning the New England home as his 'Summer Palace' and the So-Cal one for his 'Winter Palace'.
And as for the so-called Liberal 'attack points', I've got to say that those on the Right have been doing a pretty good job of their own focusing on Mitt's vulnerabilities:
http://www.climatedepot.com/a/12336/Rick-Perry-the-AntiRomney-candidate-Romney-is-out-on-the-campaign-trail-agreeing-with-manmade-global-warming-claims
http://www.theatlantic.com/politics/archive/2011/08/meet-rick-perry-the-anti-romney/243100/
http://dailycaller.com/2011/07/12/new-anti-romney-website-launches/
http://www.romneyexposed.com/?page_id=19
Just go to Google and enter 'anti-romney' and the net is full of sites, most seeming to lean from the Right, posting stuff about him or his time while Governor of Massachusetts, which appears to be emerging as his biggest liability, at least from the Right's point of view.