Sad to see him go, Rooker is a great actor, and the dynamic between him and Daryl is very good. But Rooker has tons of movie commitments, so it sorta makes sense that he'd only be a cast member for a short time.
Herschel looks to be on the short list, also.