Frankly, it doesn't suit you.

Literal

Frankly speaking matching-not.

似合ってない is a casual contraction of 似合っていない (doesn't suit/match). 率直に言って prefaces the blunt assessment. A short, direct statement — the kind of honest fashion feedback a close friend might give.