When to Retrieve: Teaching LLMs to Utilize Information Retrieval Effectively