Let's dust off the carpet.

Literal

Carpet's dust [object-を] sweep-and let's-drop.

ほこりを払う = 'to dust off / brush away dust.' ~て落とそう uses the volitional of 落とす: 'let's knock it off.' A practical household task.