Retrieval-Augmented Thought Process as Sequential Decision Making