ControlRec: Bridging the Semantic Gap between Language Model and Personalized Recommendation