They looked down on me.

Literal

They [topic-は] me [object-を] despised.

軽蔑した means 'despised, looked down on.' わたし uses a less common spelling of 私.