Efficient and Responsible Adaptation of Large Language Models for Robust Top-k Recommendations