This is actually part of the reason why Fallout 4 became one of the first in my artificial memory palace project (Link) It gives a minor challenge on creating a vibe that makes certain things unique.
Not exactly, with some asterixes. If you view it as actual events happening in the space of your memory palace, you are right. However, what if you view the memory palace as a mnemonic to memorize a peg list? I actually have a memory palace planned for the shared page, which has 250 knowledge-based loci (meaning that the effectiveness depends on your familiarity with the objects) in a building the size of a small home. So incredibly packed, and a lot of work to turn into a tour, but hopefully finished this weekend.
That is just one building. The full town will have 10 palaces, which I aim to turn into a 2000-loci place with very dense placement. A challenge, but possible.
That does pose a solution to a problem you adressed as well: no palace has thousands of loci.
A single palace will not quickly reach thousands of loci, but a combination of palaces can. The sanctuary artificial palace is a way to do that: a small town with numerous buildings that are each their own palace. Combined, the sanctuary palaces are good for 1201 loci. Red Rocket (the anticipated 2000-loci hub) is right next to it so I could even use both and already have 3201 loci set to go. Combined, the two hubs are 30 palaces, so nothing too hard.
Need more? Submerge the hubs and swim through under-water palaces. Different physics, different palace, and boom, 6402 loci in just 30 palaces.