You must not despise someone just because they're poor.

Literal

Poor [just-because-からといって] person [object-を] despise [must-not-てはいけない].

Combines ~からといって ('just because') with ~てはいけない ('must not') — a natural pairing for moral injunctions. 貧しいからといって means 'just because someone is poor.'