I drink coffee, but limit myself to one cup in the morning, and am trying to switch to oolong and green tea.
I don’t know if it helps with memory or not, but theanine is found in tea, which is probably cheaper than supplements.
From what I’ve read, it seems like ginkgo doesn’t help with memory. Some ginkgo supplements don’t even contain ginkgo.