I think it depends on how you memorize things. Using memory techniques don’t prevent you from using your regular study methods — they are just an additional tool for the study toolbox.
You can arrange things in your memory palaces whatever way you want. For some kinds of memorization, it helps with associating things.
An example would be a list where related items are next to each other. If you look up one item in the list, you can walk forwards and backwards in the list to find similar items.
I don’t think there is anything wrong. Everyone thinks differently, so what works for one person might not work for another.
Example: some people remember movies well, but I don’t have a good memory for movies. I would probably have to take notes during a movie to remember what happened (or use a memory technique).
I didn’t use a memory journey to remember my number systems, but some people do. There’s a page about it here: How do I memorize a mnemonic number or card system?