Well, realistically speaking, I'm impressed the club is still going what with all those rumors swirling around.
Literal
Well, real problem, such-kind-of rumors [subject-が] swirl among-で well club [subject-が] are-existing [quotative-と] think-[ぜ].
実際問題 ('realistically, practically speaking') is a fixed discourse marker for grounding abstract discussion in practical facts. 渦巻く ('to swirl, to whirlpool') is a dramatic verb used figuratively for rumors, gossip, or turmoil. ~中で ('in the midst of, amid') scopes a context. よく+verb means 'it's impressive that / I'm impressed how,' not literally 'often.' 存続する ('to continue existing, to remain in operation') is a Sino-Japanese verb for institutional survival. ~てる is the spoken contraction. ぜ gives masculine finality.