Search Results for "context" - Page 30
Sort By:
Showing 785 open source projects for "context"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
1
Nemotron 3
Large language model developed and released by NVIDIA
...The base Nano architecture uses a hybrid Mamba-Transformer Mixture-of-Experts (MoE) design, allowing the model to activate only a small fraction of its 31.6 billion parameters per token, which improves speed and efficiency without sacrificing quality on complex queries. This configuration supports a massive context length of up to 1 million tokens, making it suitable for long-context reasoning, agentic tasks, extended dialogues, and applications like code generation or document summarization. -
2
Nemotron 3 Super
Open language model developed by NVIDIA as part of Nemotron-3 family
...The model contains approximately 120 billion parameters, but employs a Mixture-of-Experts architecture that activates only a smaller subset of parameters during inference, improving computational efficiency while maintaining high capability. Its architecture combines Transformer attention layers with Mamba state-space components to balance long-context reasoning, memory efficiency, and high-quality language generation. The model is optimized for building AI agents that must perform complex tasks such as planning, tool usage, coding assistance, and multi-step reasoning. -
3
Mistral Small 4
Model that fuses instruct, reasoning and agentic skills
The Mistral Small 4 collection is a set of open-weight large language models developed by Mistral AI that aim to unify multiple capabilities, including instruction following, reasoning, and coding, within a single efficient architecture. These models are part of the broader Mistral Small family, which is designed to deliver strong performance across a wide range of everyday AI tasks while maintaining relatively low latency and efficient deployment requirements. The collection reflects an... -
4
Nemotron 3 Nano
LL model providing reasoning and conversational capabilities
...This architecture allows the system to maintain strong reasoning capabilities while improving throughput and reducing the computational cost associated with large context processing. The model is designed as a general-purpose language system capable of handling tasks such as chat interaction, coding assistance, document analysis, and instruction following. -
Demo Series - Small Business Backup By VeeamWatch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
-
5
Kimi K3
Powerful, native multimodal AI agentic model
Kimi K3 is an open-weight, multim is an open-weight, multimodal agentic AI model from Moonshot AI designed for advanced coding, research, reasoning, and knowledge work. Builtodal agentic AI model from Moonshot AI designed for advanced coding, research, reasoning, and knowledge work. Built with 2.8 trillion total parameters and a sparse mixture-of-experts architecture, it activates 104 billion parameters per token to with 2.8 trillion total parameters and a sparse mixture-of-experts... -
6
Qwen3.6-35B-A3B
Open multimodal model for coding, agents, and long-context tasks
...A notable addition is thinking preservation, which allows the model to retain reasoning context from earlier messages, improving iterative work and reducing redundant computation. Architecturally, it uses a Mixture-of-Experts design with 35B total parameters and 3B active, supports a native 262K-token context window, and can be extended to about 1M tokens with YaRN. It also performs strongly across coding, agent, vision, reasoning, and document-understanding benchmarks. -
7
Qwen3.6-27B
Dense multimodal Qwen model for coding, agents, and long context
...It also introduces thinking preservation, allowing it to retain reasoning traces from earlier turns to improve consistency, reduce repeated computation, and support iterative agent workflows. Qwen3.6-27B natively supports a 262K-token context window and can be extended to about 1M tokens with YaRN for ultra-long tasks. It is compatible with Transformers, vLLM, SGLang, and KTransformers, supports tool calling through Qwen-Agent. -
8
Qwen3.8-2.4T-A95B
Massive 2.4T MoE model for coding, agents, research, and reasoning
...The model emphasizes reliable autonomous execution, including stronger planning, environment feedback handling, and end-to-end completion of complex multi-step workflows. It natively supports a 262K-token context window that can be extended beyond one million tokens. Qwen3.8 also provides adjustable reasoning depth through low, medium, and xhigh reasoning-effort settings and preserves reasoning context across conversations. It is a text-only, thinking-first model and supports deployment through vLLM, SGLang, and TokenSpeed, with strong results across coding, tool use, research, and professional benchmarks. -
9
MiMo-V2.5-Pro
Flagship MoE model for long-context agents and complex coding
...It features approximately 1.02 trillion total parameters with 42B activated per inference, balancing extreme capability with efficient execution. The model supports a 1 million token context window, enabling it to maintain coherence across long workflows involving thousands of tool calls and multi-step reasoning chains. Architecturally, it uses a hybrid attention system combining Sliding Window Attention and Global Attention to significantly reduce memory usage while preserving long-context performance. It also integrates multi-token prediction modules that accelerate inference and improve reinforcement learning efficiency. ... -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
10
MiMo-V2.5
Omnimodal AI model for agents, coding, and long-context tasks
MiMo-V2.5 is a native omnimodal large language model developed by Xiaomi, designed for advanced agentic workflows, multimodal reasoning, and long-context processing. Built on a Mixture-of-Experts architecture with approximately 309B total parameters and around 15B activated per inference, it balances high capability with efficient execution. The model natively processes text, images, video, and audio within a unified system, enabling cross-modal understanding and complex task execution in a single pipeline. ... -
11
DeepSeek-V4-Flash
Efficient MoE model for million-token reasoning and coding
DeepSeek-V4-Flash is a preview Mixture-of-Experts language model built for efficient million-token context intelligence. It has 284B total parameters with 13B activated and supports a 1M-token context window, making it suitable for long-document reasoning, complex coding, agentic workflows, and large-scale information processing. The model uses a hybrid attention architecture that combines Compressed Sparse Attention and Heavily Compressed Attention to improve long-context efficiency, while Manifold-Constrained Hyper-Connections strengthen signal stability across layers. ... -
12
Qwen3-Next
Qwen3-Next: 80B instruct LLM with ultra-long context up to 1M tokens
Qwen3-Next-80B-A3B-Instruct is the flagship release in the Qwen3-Next series, designed as a next-generation foundation model for ultra-long context and efficient reasoning. With 80B total parameters and 3B activated at a time, it leverages hybrid attention (Gated DeltaNet + Gated Attention) and a high-sparsity Mixture-of-Experts architecture to achieve exceptional efficiency. The model natively supports a context length of 262K tokens and can be extended up to 1 million tokens using RoPE scaling (YaRN), making it highly capable for processing large documents and extended conversations. ... -
13
Hunyuan-A13B-Instruct
Efficient 13B MoE language model with long context and reasoning modes
...Open-source under a custom license, it's ideal for researchers and developers seeking scalable, high-context AI capabilities with optimized inference. -
14
Postproxy-MCP
MCP (Model Context Protocol) server for integrating PostProxy API
PostProxy MCP is a Model Context Protocol (MCP) server that integrates the PostProxy API directly into Claude Code, enabling AI-assisted publishing to social media platforms like Instagram, YouTube, TikTok, Facebook, LinkedIn, X/Twitter, and Threads. -
15
Hy3 preview
Efficient MoE model for reasoning, coding, and AI agent workflows
Hy3 preview is Tencent Hunyuan’s latest open-weight Mixture-of-Experts language model, designed for advanced reasoning, coding, instruction following, and autonomous agent workflows. It is the first model built on Tencent’s rebuilt training infrastructure and introduces significant improvements in context learning, software engineering, and tool-based task execution. The model features 295B total parameters with only 21B activated during inference, plus a dedicated 3.8B Multi-Token Prediction (MTP) layer that accelerates generation through speculative decoding. Architecturally, it uses 192 routed experts with top-8 activation, a dense-MoE hybrid design, and a native 256K-token context window. ... -
16
Qwen2-7B-Instruct
Instruction-tuned 7B language model for chat and complex tasks
...Built on a transformer architecture with SwiGLU activation and group query attention, it is optimized for chat, reasoning, coding, multilingual tasks, and extended context understanding up to 131,072 tokens. The model was pretrained on a large-scale dataset and aligned via supervised fine-tuning and direct preference optimization. It shows strong performance across benchmarks such as MMLU, MT-Bench, GSM8K, and Humaneval, often surpassing similarly sized open-source models. Designed for conversational use, it integrates with Hugging Face Transformers and supports long-context applications via YARN and vLLM for efficient deployment. -
17
QwQ-32B
QwQ-32B is a reasoning-focused language model for complex tasks
...For long input handling, it supports YaRN (Yet another RoPE Namer) for context scaling. -
18
LongCat-2.0
Trillion-parameter MoE model for coding and million-token reasoning
...The model was pretrained on more than 35 trillion tokens and trained entirely on a large-scale cluster of domestically developed AI accelerators, demonstrating stable frontier-scale training without rollback events. LongCat-2.0 introduces LongCat Sparse Attention and extensive 1M-context training, enabling native processing of million-token inputs for long-document analysis, repository-scale coding, and complex multi-step reasoning. Dedicated post-training further strengthens coding and agent performance, producing competitive benchmark results against leading proprietary models. -
19
Devstral Small 2
Lightweight 24B agentic coding model with vision and long context
...The model achieves competitive performance on SWE-bench, validating its effectiveness for real-world coding and automation tasks. It introduces vision capabilities, enabling image understanding alongside text for more versatile development workflows. Devstral Small 2 supports a 256k context window, allowing it to reason across large repositories, long diffs, and extended technical contexts. Its architecture improves generalization across diverse prompts and coding environments while leveraging advanced attention scaling techniques. -
20
Qwen2.5-14B-Instruct
Powerful 14B LLM with strong instruction and long-text handling
Qwen2.5-14B-Instruct is a powerful instruction-tuned language model developed by the Qwen team, based on the Qwen2.5 architecture. It features 14.7 billion parameters and is optimized for tasks like dialogue, long-form generation, and structured output. The model supports context lengths up to 128K tokens and can generate up to 8K tokens, making it suitable for long-context applications. It demonstrates improved performance in coding, mathematics, and multilingual understanding across over 29 languages. Qwen2.5-14B-Instruct is built on a transformer backbone with RoPE, SwiGLU, RMSNorm, and attention QKV bias. ... -
21
Nemotron 3.5 Lightning
Efficient 30B MoE model for long-running agents and local inference
...It uses a hybrid Mixture-of-Experts architecture combining Mamba-2, MoE, and selected attention layers, with 30B total parameters but only 3B active during inference. The model supports context windows up to 1 million tokens, enabling long-running workflows and large-context reasoning. Its NVFP4 quantization reduces deployment requirements while targeting NVIDIA hardware ranging from DGX Spark and RTX 5090 systems to H100, H200, and GB200 accelerators. NVIDIA also provides DSpark, Multi-Token Prediction, and DFlash speculative decoding methods to accelerate text generation. ... -
22
DiffusionGemma
NVFP4 DiffusionGemma model for fast multimodal text generation
...Its diffusion-based generation produces tokens in parallel 256-token blocks, enabling very high-speed output, with reported generation above 1,100 tokens per second on NVIDIA Hopper H100 in FP8. The model supports a 256K-token context window, configurable thinking mode, native function calling, structured JSON output, and multilingual inference across 35+ languages. The NVFP4 quantization reduces weights and activations from 16-bit to 4-bit, lowering disk size and GPU memory needs for vLLM deployment. -
23
Gemma 4 12B
Unified multimodal Gemma model for local coding and reasoning
...It supports text, image, audio, and video inputs with text output, making it useful for transcription, image understanding, video analysis, coding, and agentic workflows. The model has 11.95B parameters, 48 layers, a 256K-token context window, and support for over 140 languages. It also includes configurable thinking modes, native system prompt support, function calling, and strong benchmark performance for its size. It is optimized for consumer GPUs, workstations, and streamlined local deployment. -
24
Qwen3.6-35B-A3B-FP8
FP8 Qwen model for efficient multimodal coding and agent tasks
...It is a multimodal open-weight model that combines a causal language model with a vision encoder, supporting text, image, and video inputs. Built for stability and real-world developer use, it emphasizes agentic coding, repository-level reasoning, and productive long-context workflows. A key capability is thinking preservation, which allows the model to retain reasoning traces from earlier messages, helping reduce repeated computation and improving consistency in iterative tasks. The model uses a Mixture-of-Experts design with 35B total parameters and 3B active, supports a native context window of 262,144 tokens, and can be extended to about 1,010,000 tokens with YaRN. ... -
25
Kimi K2.7 Code
Coding-focused Kimi model for long-horizon agent workflows
...It improves end-to-end task completion across real-world programming scenarios while reducing thinking-token usage by about 30% compared with K2.6. Architecturally, it uses a 1T-parameter Mixture-of-Experts design with 32B activated parameters, 61 layers, 384 experts, a 256K-token context window, and a MoonViT vision encoder. The model supports image and video input, native INT4 quantization, interleaved thinking, and multi-step tool calling. It also forces preserve-thinking mode by default, retaining full reasoning context across multi-turn interactions to improve coding-agent consistency. K2.7 Code is recommended for use through Kimi Code CLI and can be deployed with vLLM, SGLang, or KTransformers.
