He actually looks ashamed at that. There's another long pause before he says, "It'd be a lot better if you let that be what happened."

It doesn't come off like a threat; if anything he sounds concerned.