Reusing Memory Palaces

Is it possible to reuse memory palaces? A few months ago I tried to memorize all the 00-99 person object and action system using Anki. For this I used four houses that I knew. I was not very comfortable with memory palaces and therefor used up the houses very fast. Do you think memory palaces can be forgotten? Because every time I try to use it again I see ghosts of the previous inhabitants. It’s really like its haunted! Could you please help me out?

I asked this because I want to memorize a lot of facts. I frequently appear for quizzes.