A Stitch in Time Saves Nine: Small VLM is a Precise Guidance for Accelerating Large VLMs