It's a perfectly reasonable explanation, but Jim still feels a bit guilty about it. "It all happened so fast..." In a way, he's still reeling from the attack that killed Admiral Pike, the firefight that started this whole spiral into destruction. Everyone else has had a few weeks to process it, but for Jim, Pike might as well have died yesterday.