She felt her knees trembling.

Literal

She [topic-は] knees [subject-が] trembling [object-を] felt.

膝が震えるのを感じた — a perception construction where の nominalizes the trembling and を marks it as the object of 感じる ('to feel/perceive').