Wonder if you mean by 'bulking up', adding pure muscle mass or more body fat. If your guessing your body fat is around 20-25%, than that may be a wild guess. Try to get a true reading of the percentage of that extra fat. Then you know where you really stand. 4000 calories is very high, so you may want to drop them to the range of 2800 to 3000 a day, enought for maintence, muscle growth and general health reasons. Also drop the carbs to around 100 grams a day while on this lower calorie level. Fairly easy when flour, pasta, etc are taken out of the diet. Get a carb counter book. You should never feel hungry if you plan your meals correctly.
You didn't say how you were working out five days a week; weights,set's, reps, body parts, cardio, etc. As a rule of thumb, three day's of BB'ing and two or three day's of some type of cardio, of this type of program, should give the results you are seeking. Change around you cardio workout with things, like running, power walking, treadmill, bike, steppers, etc. One way to fight boredom. Cardio sessions can be from 20 to 30 minutes, nothing more is not needed. Might also do a search for the Tabata and other interval cardio training methods. Good luck.