How do you know we're not from alternate universes?

[ it's a possibility, isn't it? castiel casts his gaze upward, as though he's considering the proposition. it's then that something occurs to him. ]

If I was brought here when the Darkness was still at large, how could I be there in your time?