The egg yolks were "supposedly" linked to high "dietary" cholesterol. The cholesterol levels one would be worried about specifically would be 'blood serum levels' (overall) of cholesterol--even more specifically: "LDLs" Low Density Lipoproteins.
Your genetic makeup would be the deciding factor in how much food would actually affect your liver's daily output. If you eat more (dietary) cholesterol, your liver may make less. If you eat less cholesterol, your liver may make more.
Consequently, there are specific substances in an egg yolk that have the capacity to lower blood serum levels of cholesterol. This is lecithin. Some studies in the past have shown that lecithin was nearly as effective (for some) as a statin drug.
Many people with high cholesterol live to be healthy old folks. My dad is 82 and has been eating eggs for breakfast 5 days a week... that is how he was raised. Some folks may have low cholesterol and develop heart disease.
This is the funny thing to me about doctors right away recommending a better diet and exercise when they find you have high overall cholesterol levels. Sure, a better diet has a great synergistic effect for the body combined with exercise, but if the liver has already decided on its output levels of cholesterol, rarely will diet and exercise change those levels significantly.
generally folks with cholesterol levels that are too high end up on a statin drug prescription... for life.