Search Results for "pc benchmark testing"

ARC-AGI-1 Task Generator creates new ARC-style reasoning tasks whose distribution is designed to resemble the public ARC-AGI-1 evaluation set. It provides fresh problems that models are less likely to have encountered during training or previous evaluation. The project is intended to complement public benchmark scores by testing whether reasoning abilities transfer to newly generated examples. Generated tasks use the standard ARC train-and-test JSON structure. This makes the output compatible with existing ARC evaluation harnesses and analysis pipelines. The repository also includes scripts for labeling, describing, visualizing, and generating tasks, including stratified generation. ...

MiniMax-M2.5 is a state-of-the-art foundation model extensively trained with reinforcement learning across hundreds of thousands of real-world environments. It delivers leading performance in coding, agentic tool use, search, and complex office workflows, achieving top benchmark scores such as 80.2% on SWE-Bench Verified and 76.3% on BrowseComp. Designed to reason efficiently and decompose tasks like an experienced architect, M2.5 plans features, structure, and system design before generating code. The model supports full-stack development across web, mobile, and desktop platforms, covering the entire lifecycle from system design to testing and code review. ...