So in a nutshell, the Venice/Santa Monica area is a dump? 
Venice ain't that bad but don't expect paradise... the beach is terrible - zero waves - lots of $2 shops and street people etc. Golds is cool obviously.
Santa Monica ain't bad imo - good place to see a movie at night since there are about 4 theatres.
Hollywood I don't mind personally but I like to see live gigs etc - the roxy, viper room etc are on sunset.
Golds in west hollywood is a good gym - lots of gays but that doesn't bother me personally since they never bother me much anyway...
Beach wise go to manhatten beach and hermosa beach south of the airport. hermosa has pretty good night life with lots of partying going on and at least the beach has some waves for a surf even if they are pretty small.
If you don't like LA jump across to vegas, it's a nice drive mid week imo...