I borrowed that book from this library.

Literal

I [topic-は] this library [at-で] that book [object-を] borrowed.

借りる ('to borrow') with で marks the location where the borrowing happened — using the library is a place-based action. English would say 'from the library,' but Japanese uses で because the borrowing happens AT the library; から would mark a source person rather than a place.