People don't want to have to justify their privileges; they don't want to have to justify having access to the power and resource that wealth brings. And by not talking about it, they are able to hold onto their power without being questioned, and I think that makes them feel more secure.