Yes, I’ve had three different versions - the old model 3, the model 4 (now called the HD I think), and now the 4K which I got on the day it was released.
Memory is for buffering and so on and, as DaveB says, games and other apps need memory to work with. (Come to that, the UI is really a bunch of apps that need memory to work with).
I had 32GB in the 4, but went for the full 64GB for the 4K because it’s only an extra £20 (£199 v. £179). I have absolutely no idea whether or not I’ve benefited in any way from this decision, as I only use it for watching video and occasionally streaming music and video from one of the Macs.