I-m-afraid-so Definition

Unfortunately, yes; I regret that that is so.

Do we really have to do every one by hand? Yes, I'm afraid so.
Wiktionary