My father used to go to Detroit on business every year.

Literal

Father [topic-は] every-year Detroit [to-へ] work [to-へ] was-going.

毎年 marks the yearly frequency. 行っていた uses ~ていた for a past habitual action.