Not necessarily. Maybe they don't care about building wealth.
Most wealthy people own a business. Running a business is hard work. Hard work includes physical and mental work. Running a construction company involves physical work. Running a doctor's office requires mental work.
Maybe they do care about building great wealth only they're not capable of doing it.
I've had a few different businesses & none of them required much hard physical labour,
Running around & organising- most of the metal 'hard work' revolved around other
People - managing them & get them to work as required etc.
Go digging out trenches with a shovel in 35+c heat or -5+c temps & compare that to
Mental 'hard work' vast difference in who tired you feel at the end of your shift.
I know which I'd choose every day of the week . 😊