Thru trial and error you have to find out exacty what exericises are causing this. In your case you might already know. Once the problem's isolated to certain exercises, you can first try different variations of the same exercise and see whether that allows you to continue the movement without pain.
In the case of shoulder presses, try the same thing using DBs instead of BB, or use a machine. The grip and grip width can make a huge difference in how the shoulder feels.
And of course make sure there's always a good warmup first. Then keep rests between sets at 1 minute or less.
Also, keep the reps on the higher side using less weight. Reps in the 10-15 range, not lower. That works well for delts anyway, and will remove some of the joint stress that heavier weights cause.
If all of that doesn't work, eliminate the exercise all together. Yes, laterals will do the job on lateral delts, they're great..
On biceps same thing, eliminate the problem exercises one at a time for a few weeks and figure out which one(s) are causing the problems, then go thru the same process as above to find less problematic alternatives.