In the context of our society and with "lots" meaning billions - yes it is immoral. I'm sure we've all seen a number of graphics/chats/whatever trying to show wealth inequality, but this is the best one I've come across. Would recommend giving it a look and then asking yourself if having a lot of money isn't immoral.
https://mkorostoff.github.io/1-pixel-wealth/