You must not go there with them.

Literal

They [with-と] there [to-へ] go [must not-てはいけません].

~てはいけません is the polite prohibition. 彼等とそこへ specifies both the companion and destination.