The old man was sitting all alone.

Literal

Old-man [topic-は] merely alone sitting-was.

たった + ひとりで emphasizes isolation. たった ('merely, just') intensifies 'alone' into something more poignant. ~ていた marks the ongoing past state. A lonely image.