My father got angry at his son for doing such a stupid thing.

Literal

Father [topic-は] such foolish thing [object-を] did fact [because of-で] son [at-に] belly [object-を] stood-up.

腹を立てる ('to stand up one's belly') is a set idiom meaning 'to get angry.' ~したことで uses で after a nominalized clause to mark the reason. One of many Japanese expressions mapping emotions onto body parts — the belly (腹) is the seat of inner feeling.