Graph of Thoughts is an open-source framework that implements a novel reasoning paradigm for large language models by organizing reasoning steps as a structured graph instead of a simple linear chain. Traditional reasoning methods such as chain-of-thought generate sequential reasoning steps, but Graph of Thoughts introduces a more flexible structure where multiple reasoning paths can be explored and evaluated simultaneously. In this framework, problems are modeled as a graph of operations where nodes represent reasoning steps and edges represent dependencies between them. The framework executes these operations using a large language model as the reasoning engine while evaluating intermediate results to guide the search process. This approach enables models to explore multiple reasoning strategies in parallel and choose the most promising solutions during problem solving.
Features
- Graph-based reasoning framework that structures problem solving as operations
- Execution engine that uses large language models to process reasoning steps
- Support for multiple reasoning strategies including chain-of-thought and tree-of-thought
- Flexible architecture for implementing custom reasoning workflows
- Evaluation mechanisms that score intermediate reasoning results
- Framework for solving complex analytical problems using structured reasoning