I cannot use the portal to sanctum using the Orb of Many Ways. I even waited out the kill timer to be sure. It says "the portal only reacts to the orb of many ways" when I use it. The only thing I can think of is that I skipped Tannen's quest and the game doesn't consider me to have the same Orb of Many Ways as the one you get back from him.
was going to be my first Insane clear

Very unhappy about this fate.