Search Results for "100"

DB-GPT is an experimental open-source project that uses localized GPT large models to interact with your data and environment. With this solution, you can be assured that there is no risk of data leakage, and your data is 100% private and secure.

...The model supports full-stack development across web, mobile, and desktop platforms, covering the entire lifecycle from system design to testing and code review. With native serving speeds of up to 100 tokens per second, it completes complex agentic tasks significantly faster than previous versions while maintaining high token efficiency. M2.5 is built to be highly cost-effective, enabling continuous deployment of powerful AI agents at a fraction of the cost of other frontier models.

...Compared to the first generation, it delivers a significant boost in programming ability across multiple languages, outperforming even larger models like StarCoder-15B in some benchmarks despite having only 6B parameters. The model excels at code generation, translation, summarization, debugging, and comment generation, and it supports over 100 programming languages. With improved inference efficiency, quantization options, and multi-query/flash attention, CodeGeeX2 achieves faster generation speeds and lightweight deployment, requiring as little as 6GB GPU memory at INT4 precision. Its backend powers the CodeGeeX IDE plugins for VS Code, JetBrains, and other editors, offering developers interactive AI assistance with features like infilling and cross-file completion.

...It is specifically optimized for local and resource-constrained deployment and has been validated on NVIDIA DGX Spark, Apple Silicon MacBooks, and Mac mini systems. FP8 testing reached around 100–105 tokens/s on DGX Spark and 86–90 tokens/s on an M4 Pro MacBook. BF16, FP8, and INT4 weights are available, while deployment options include SGLang, vLLM, and experimental Ollama support on Apple Silicon.

...Distilled from the larger Muse Spark, it combines multi-step reasoning, reliable tool use, coding, failure recovery, and image understanding in a dense 29.6B-parameter architecture with a dedicated 1.8B-parameter perception encoder. It supports more than 100 languages and a 131K+ token context window, allowing agents to maintain coherent plans across extended workflows. Muse Glimmer can interpret screenshots, charts, documents, and images alongside text, while configurable reasoning strength lets developers balance response quality and speed. Its quantized variants reduce the model below 20 GB for operation on systems with 24–32 GB of memory, and DFlash speculative decoding can substantially accelerate generation.