よんどころない ('unavoidable, can't be helped') is a somewhat literary adjective — the same root as やむを得ない but with a more formal, old-fashioned flavor. 別荘 ('villa, vacation home') implies affluence. 過ごせない is the negative potential of 過ごす 'to spend (time).' The speaker regrets missing their usual summer retreat.