ToME: the Tales of Maj'Eyal

I feel like this is a really stupid question, but I can't seem to figure out how to get my golem back after I die and respawn? I see the icon for the golem in the upper left, but I don't actually see him in the world. When I try to right click on the golem item, I get the message "Can not give ...