Large Language Models as Optimizers: A Survey of Direct vs. Tool-Augmented Approaches and Their Performance Frontiers

A survey of large language models used as optimizers, contrasting direct
prompting approaches with tool-augmented pipelines and characterising the
performance frontiers of each. (DOI/abstract pending verification.)