Search Results for "openai"

RETRO (Retrieval-Enhanced Transformer) is a large language model architecture developed by OpenAI that augments transformer models with a retrieval mechanism. Instead of relying solely on learned parameters, RETRO retrieves relevant documents from a large external database during inference, allowing it to ground responses in external knowledge. This design improves factual accuracy, reduces hallucinations, and enables smaller models to perform comparably to much larger ones by leveraging retrieval. ...

...The project is built to test scalability in multi-agent reinforcement learning, with features such as procedurally generated terrain and configurable game mechanics. While the original release has since been succeeded by newer versions maintained outside OpenAI, it remains a landmark framework for studying large-scale agent interactions in complex environments.