What's with all this space timey-wimey stuff? Let the Doctor/Kilgrave (too soon?) explain.
Either The Doctor traveled to the wrong universe, or it's a coincidence.