Reasoning is not only an essential aspect of human intelligence but also one of the main research topics in artificial intelligence. With the recent revolutionary developments in natural language processing, it has been observed that large language models possess a degree of reasoning capabilities. When elicited by prompting, these models can exhibit impressive performance in various reasoning tasks. In this paper, we survey the recent advances in reasoning by prompting large language models. We provide an overview of key benchmarks and categorize the different reasoning methods. Our survey focuses on the most recent advancements in this field and seeks to provide a comprehensive understanding of the current state-of-the-art.