Search Results for "factory"

LLaMA-Factory is a fine-tuning and training framework for Meta's LLaMA language models. It enables researchers and developers to train and customize LLaMA models efficiently using advanced optimization techniques.

KVCache-Factory is an open-source research framework designed to explore and implement unified key-value cache compression techniques for autoregressive transformer models. In large language models, the key-value cache stores intermediate attention states that enable efficient token generation during inference, but these caches can consume large amounts of GPU memory when handling long contexts.

...It contains approximately 225.8B total parameters with 23.4B activated per token, making it substantially larger and more capable than Laguna XS.2 while maintaining efficient inference through sparse activation. Trained from scratch on roughly 30 trillion tokens using Poolside’s in-house “Model Factory” pipeline, the model focuses on complex software development tasks, repository-scale reasoning, tool use, and multi-step agent execution. Laguna M.1 was designed to compete with leading frontier coding models on benchmarks such as SWE-Bench, Terminal-Bench, and other agentic engineering evaluations. It supports reasoning, tool calling, and long-context workflows, making it suitable for autonomous coding agents, software maintenance, debugging, and large-scale development projects.